2023-11-28 14:53:15,236 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-28 14:53:15,488 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64 2023-11-28 14:53:15,505 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-28 14:53:15,506 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/cluster_bd31adab-41c5-d4fc-580e-11c102568516, deleteOnExit=true 2023-11-28 14:53:15,506 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-28 14:53:15,506 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/test.cache.data in system properties and HBase conf 2023-11-28 14:53:15,507 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/hadoop.tmp.dir in system properties and HBase conf 2023-11-28 14:53:15,507 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/hadoop.log.dir in system properties and HBase conf 2023-11-28 14:53:15,508 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-28 14:53:15,508 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-28 14:53:15,509 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-28 14:53:15,641 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-28 14:53:16,120 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-28 14:53:16,126 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-28 14:53:16,127 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-28 14:53:16,127 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-28 14:53:16,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-28 14:53:16,128 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-28 14:53:16,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-28 14:53:16,129 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-28 14:53:16,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-28 14:53:16,130 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-28 14:53:16,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/nfs.dump.dir in system properties and HBase conf 2023-11-28 14:53:16,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/java.io.tmpdir in system properties and HBase conf 2023-11-28 14:53:16,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-28 14:53:16,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-28 14:53:16,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-28 14:53:16,786 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-28 14:53:16,792 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-28 14:53:17,166 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-28 14:53:17,365 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-28 14:53:17,383 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-28 14:53:17,417 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-28 14:53:17,449 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/java.io.tmpdir/Jetty_localhost_40721_hdfs____d86bms/webapp 2023-11-28 14:53:17,602 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40721 2023-11-28 14:53:17,613 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-28 14:53:17,613 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-28 14:53:18,149 WARN [Listener at localhost/46715] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-28 14:53:18,236 WARN [Listener at localhost/46715] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-28 14:53:18,259 WARN [Listener at localhost/46715] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-28 14:53:18,266 INFO [Listener at localhost/46715] log.Slf4jLog(67): jetty-6.1.26 2023-11-28 14:53:18,272 INFO [Listener at localhost/46715] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/java.io.tmpdir/Jetty_localhost_46565_datanode____cpnp3t/webapp 2023-11-28 14:53:18,375 INFO [Listener at localhost/46715] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46565 2023-11-28 14:53:18,729 WARN [Listener at localhost/45519] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-28 14:53:19,267 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x90bf76e209a4e730: Processing first storage report for DS-f2107c6f-cedf-416e-9e5d-9b11c4dbf1f2 from datanode e9f24fa8-9bf6-4aac-9d23-0b21e1920771 2023-11-28 14:53:19,269 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x90bf76e209a4e730: from storage DS-f2107c6f-cedf-416e-9e5d-9b11c4dbf1f2 node DatanodeRegistration(127.0.0.1:42371, datanodeUuid=e9f24fa8-9bf6-4aac-9d23-0b21e1920771, infoPort=46649, infoSecurePort=0, ipcPort=45519, storageInfo=lv=-57;cid=testClusterID;nsid=570922336;c=1701183196873), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-28 14:53:19,269 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x90bf76e209a4e730: Processing first storage report for DS-ad9f45a4-b024-4cc4-b4d5-6f062f6dc889 from datanode e9f24fa8-9bf6-4aac-9d23-0b21e1920771 2023-11-28 14:53:19,269 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x90bf76e209a4e730: from storage DS-ad9f45a4-b024-4cc4-b4d5-6f062f6dc889 node DatanodeRegistration(127.0.0.1:42371, datanodeUuid=e9f24fa8-9bf6-4aac-9d23-0b21e1920771, infoPort=46649, infoSecurePort=0, ipcPort=45519, storageInfo=lv=-57;cid=testClusterID;nsid=570922336;c=1701183196873), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-28 14:53:19,349 DEBUG [Listener at localhost/45519] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64 2023-11-28 14:53:19,459 INFO [Listener at localhost/45519] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/cluster_bd31adab-41c5-d4fc-580e-11c102568516/zookeeper_0, clientPort=62725, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/cluster_bd31adab-41c5-d4fc-580e-11c102568516/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/cluster_bd31adab-41c5-d4fc-580e-11c102568516/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-28 14:53:19,473 INFO [Listener at localhost/45519] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62725 2023-11-28 14:53:19,480 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-28 14:53:19,483 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-28 14:53:20,177 INFO [Listener at localhost/45519] util.FSUtils(471): Created version file at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf with version=8 2023-11-28 14:53:20,178 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/hbase-staging 2023-11-28 14:53:20,497 INFO [Listener at localhost/45519] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-28 14:53:20,975 INFO [Listener at localhost/45519] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-28 14:53:21,007 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-28 14:53:21,008 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-28 14:53:21,008 INFO [Listener at localhost/45519] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-28 14:53:21,008 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-28 14:53:21,008 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-28 14:53:21,161 INFO [Listener at localhost/45519] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-28 14:53:21,231 DEBUG [Listener at localhost/45519] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-28 14:53:21,324 INFO [Listener at localhost/45519] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35905 2023-11-28 14:53:21,334 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-28 14:53:21,335 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-28 14:53:21,358 INFO [Listener at localhost/45519] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35905 connecting to ZooKeeper ensemble=127.0.0.1:62725 2023-11-28 14:53:21,403 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:359050x0, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-28 14:53:21,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35905-0x100347b7ced0000 connected 2023-11-28 14:53:21,439 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-28 14:53:21,440 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-28 14:53:21,444 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-28 14:53:21,452 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35905 2023-11-28 14:53:21,452 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35905 2023-11-28 14:53:21,453 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35905 2023-11-28 14:53:21,453 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35905 2023-11-28 14:53:21,454 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35905 2023-11-28 14:53:21,460 INFO [Listener at localhost/45519] master.HMaster(444): hbase.rootdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf, hbase.cluster.distributed=false 2023-11-28 14:53:21,531 INFO [Listener at localhost/45519] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-28 14:53:21,532 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-28 14:53:21,532 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-28 14:53:21,532 INFO [Listener at localhost/45519] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-28 14:53:21,532 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-28 14:53:21,532 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-28 14:53:21,537 INFO [Listener at localhost/45519] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-28 14:53:21,541 INFO [Listener at localhost/45519] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41403 2023-11-28 14:53:21,543 INFO [Listener at localhost/45519] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-28 14:53:21,550 DEBUG [Listener at localhost/45519] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-28 14:53:21,551 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-28 14:53:21,554 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-28 14:53:21,556 INFO [Listener at localhost/45519] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41403 connecting to ZooKeeper ensemble=127.0.0.1:62725 2023-11-28 14:53:21,560 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:414030x0, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-28 14:53:21,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41403-0x100347b7ced0001 connected 2023-11-28 14:53:21,561 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-28 14:53:21,563 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-28 14:53:21,564 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-28 14:53:21,564 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41403 2023-11-28 14:53:21,565 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41403 2023-11-28 14:53:21,568 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41403 2023-11-28 14:53:21,569 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41403 2023-11-28 14:53:21,569 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41403 2023-11-28 14:53:21,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:53:21,580 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-28 14:53:21,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:53:21,601 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-28 14:53:21,601 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-28 14:53:21,602 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:53:21,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-28 14:53:21,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35905,1701183200327 from backup master directory 2023-11-28 14:53:21,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-28 14:53:21,608 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:53:21,608 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-28 14:53:21,609 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-28 14:53:21,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:53:21,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-28 14:53:21,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-28 14:53:21,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/hbase.id with ID: e2f09a4b-1cf8-46b3-9468-589ee33ddd1e 2023-11-28 14:53:21,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-28 14:53:21,750 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:53:21,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7e9f2ec5 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:53:21,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@685c97d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:53:21,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-28 14:53:21,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-28 14:53:21,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-28 14:53:21,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-28 14:53:21,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-28 14:53:21,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-28 14:53:21,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-28 14:53:21,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/data/master/store-tmp 2023-11-28 14:53:21,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:21,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-28 14:53:21,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-28 14:53:21,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-28 14:53:21,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-28 14:53:21,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-28 14:53:21,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-28 14:53:21,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-28 14:53:21,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/WALs/jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:53:21,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35905%2C1701183200327, suffix=, logDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/WALs/jenkins-hbase4.apache.org,35905,1701183200327, archiveDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/oldWALs, maxLogs=10 2023-11-28 14:53:22,003 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42371,DS-f2107c6f-cedf-416e-9e5d-9b11c4dbf1f2,DISK] 2023-11-28 14:53:22,011 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-28 14:53:22,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/WALs/jenkins-hbase4.apache.org,35905,1701183200327/jenkins-hbase4.apache.org%2C35905%2C1701183200327.1701183201957 2023-11-28 14:53:22,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42371,DS-f2107c6f-cedf-416e-9e5d-9b11c4dbf1f2,DISK]] 2023-11-28 14:53:22,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:53:22,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:22,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-28 14:53:22,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-28 14:53:22,135 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-28 14:53:22,144 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-28 14:53:22,167 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-28 14:53:22,179 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:22,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-28 14:53:22,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-28 14:53:22,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-28 14:53:22,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:53:22,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65866103, jitterRate=-0.018518581986427307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:53:22,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-28 14:53:22,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-28 14:53:22,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-28 14:53:22,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-28 14:53:22,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-28 14:53:22,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-28 14:53:22,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 32 msec 2023-11-28 14:53:22,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-28 14:53:22,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-28 14:53:22,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-28 14:53:22,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-28 14:53:22,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-28 14:53:22,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-28 14:53:22,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-28 14:53:22,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-28 14:53:22,357 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:53:22,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-28 14:53:22,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-28 14:53:22,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-28 14:53:22,376 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-28 14:53:22,376 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-28 14:53:22,376 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:53:22,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35905,1701183200327, sessionid=0x100347b7ced0000, setting cluster-up flag (Was=false) 2023-11-28 14:53:22,393 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:53:22,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-28 14:53:22,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:53:22,411 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:53:22,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-28 14:53:22,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:53:22,422 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp 2023-11-28 14:53:22,473 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(954): ClusterId : e2f09a4b-1cf8-46b3-9468-589ee33ddd1e 2023-11-28 14:53:22,477 DEBUG [RS:0;jenkins-hbase4:41403] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-28 14:53:22,484 DEBUG [RS:0;jenkins-hbase4:41403] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-28 14:53:22,484 DEBUG [RS:0;jenkins-hbase4:41403] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-28 14:53:22,489 DEBUG [RS:0;jenkins-hbase4:41403] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-28 14:53:22,492 DEBUG [RS:0;jenkins-hbase4:41403] zookeeper.ReadOnlyZKClient(139): Connect 0x7daaa6e8 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:53:22,497 DEBUG [RS:0;jenkins-hbase4:41403] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@736d572d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:53:22,498 DEBUG [RS:0;jenkins-hbase4:41403] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7752cd98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-28 14:53:22,530 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41403 2023-11-28 14:53:22,533 INFO [RS:0;jenkins-hbase4:41403] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-28 14:53:22,533 INFO [RS:0;jenkins-hbase4:41403] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-28 14:53:22,533 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1025): About to register with Master. 2023-11-28 14:53:22,536 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,35905,1701183200327 with isa=jenkins-hbase4.apache.org/172.31.14.131:41403, startcode=1701183201531 2023-11-28 14:53:22,552 DEBUG [RS:0;jenkins-hbase4:41403] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-28 14:53:22,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-28 14:53:22,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-28 14:53:22,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-28 14:53:22,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-28 14:53:22,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-28 14:53:22,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-28 14:53:22,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-28 14:53:22,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1701183232569 2023-11-28 14:53:22,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-28 14:53:22,576 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-28 14:53:22,576 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-28 14:53:22,582 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-28 14:53:22,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-28 14:53:22,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-28 14:53:22,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-28 14:53:22,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-28 14:53:22,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-28 14:53:22,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-28 14:53:22,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-28 14:53:22,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-28 14:53:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-28 14:53:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-28 14:53:22,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701183202599,5,FailOnTimeoutGroup] 2023-11-28 14:53:22,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701183202599,5,FailOnTimeoutGroup] 2023-11-28 14:53:22,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-28 14:53:22,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,608 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35699, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-28 14:53:22,621 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35905] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:22,635 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf 2023-11-28 14:53:22,635 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:46715 2023-11-28 14:53:22,635 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2023-11-28 14:53:22,640 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-28 14:53:22,641 DEBUG [RS:0;jenkins-hbase4:41403] zookeeper.ZKUtil(163): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:22,641 WARN [RS:0;jenkins-hbase4:41403] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-28 14:53:22,641 INFO [RS:0;jenkins-hbase4:41403] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-28 14:53:22,642 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1951): logDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/WALs/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:22,643 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41403,1701183201531] 2023-11-28 14:53:22,650 DEBUG [RS:0;jenkins-hbase4:41403] zookeeper.ZKUtil(163): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:22,661 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-28 14:53:22,670 INFO [RS:0;jenkins-hbase4:41403] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-28 14:53:22,688 INFO [RS:0;jenkins-hbase4:41403] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-28 14:53:22,692 INFO [RS:0;jenkins-hbase4:41403] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:53:22,692 INFO [RS:0;jenkins-hbase4:41403] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,693 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2023-11-28 14:53:22,700 INFO [RS:0;jenkins-hbase4:41403] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,700 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,700 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,700 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,701 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,701 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,701 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-28 14:53:22,701 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,701 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,701 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,701 DEBUG [RS:0;jenkins-hbase4:41403] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-28 14:53:22,702 INFO [RS:0;jenkins-hbase4:41403] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,702 INFO [RS:0;jenkins-hbase4:41403] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,702 INFO [RS:0;jenkins-hbase4:41403] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,718 INFO [RS:0;jenkins-hbase4:41403] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-28 14:53:22,720 INFO [RS:0;jenkins-hbase4:41403] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41403,1701183201531-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:22,736 INFO [RS:0;jenkins-hbase4:41403] regionserver.Replication(203): jenkins-hbase4.apache.org,41403,1701183201531 started 2023-11-28 14:53:22,736 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,41403,1701183201531, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41403, sessionid=0x100347b7ced0001 2023-11-28 14:53:22,737 DEBUG [RS:0;jenkins-hbase4:41403] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-28 14:53:22,737 DEBUG [RS:0;jenkins-hbase4:41403] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:22,737 DEBUG [RS:0;jenkins-hbase4:41403] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41403,1701183201531' 2023-11-28 14:53:22,737 DEBUG [RS:0;jenkins-hbase4:41403] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:22,738 DEBUG [RS:0;jenkins-hbase4:41403] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:22,738 DEBUG [RS:0;jenkins-hbase4:41403] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-28 14:53:22,738 DEBUG [RS:0;jenkins-hbase4:41403] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-28 14:53:22,739 DEBUG [RS:0;jenkins-hbase4:41403] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:22,739 DEBUG [RS:0;jenkins-hbase4:41403] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41403,1701183201531' 2023-11-28 14:53:22,739 DEBUG [RS:0;jenkins-hbase4:41403] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-28 14:53:22,739 DEBUG [RS:0;jenkins-hbase4:41403] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-28 14:53:22,740 DEBUG [RS:0;jenkins-hbase4:41403] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-28 14:53:22,740 INFO [RS:0;jenkins-hbase4:41403] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-28 14:53:22,740 INFO [RS:0;jenkins-hbase4:41403] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-28 14:53:22,851 INFO [RS:0;jenkins-hbase4:41403] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41403%2C1701183201531, suffix=, logDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/WALs/jenkins-hbase4.apache.org,41403,1701183201531, archiveDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/oldWALs, maxLogs=32 2023-11-28 14:53:22,870 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42371,DS-f2107c6f-cedf-416e-9e5d-9b11c4dbf1f2,DISK] 2023-11-28 14:53:22,874 INFO [RS:0;jenkins-hbase4:41403] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/WALs/jenkins-hbase4.apache.org,41403,1701183201531/jenkins-hbase4.apache.org%2C41403%2C1701183201531.1701183202854 2023-11-28 14:53:22,874 DEBUG [RS:0;jenkins-hbase4:41403] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42371,DS-f2107c6f-cedf-416e-9e5d-9b11c4dbf1f2,DISK]] 2023-11-28 14:53:23,019 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-28 14:53:23,020 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-28 14:53:23,020 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf 2023-11-28 14:53:23,435 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:23,437 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-28 14:53:23,440 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/info 2023-11-28 14:53:23,441 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-28 14:53:23,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:23,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-28 14:53:23,445 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/rep_barrier 2023-11-28 14:53:23,445 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-28 14:53:23,446 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:23,446 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-28 14:53:23,449 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/table 2023-11-28 14:53:23,449 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-28 14:53:23,450 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:23,452 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740 2023-11-28 14:53:23,453 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740 2023-11-28 14:53:23,456 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-28 14:53:23,458 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-28 14:53:23,461 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:53:23,462 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68105091, jitterRate=0.014844939112663269}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-28 14:53:23,462 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-28 14:53:23,462 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-28 14:53:23,462 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-28 14:53:23,462 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-28 14:53:23,462 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-28 14:53:23,462 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-28 14:53:23,463 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-28 14:53:23,463 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-28 14:53:23,468 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-28 14:53:23,468 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-28 14:53:23,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-28 14:53:23,486 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-28 14:53:23,489 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-28 14:53:23,640 DEBUG [jenkins-hbase4:35905] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-28 14:53:23,644 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41403,1701183201531, state=OPENING 2023-11-28 14:53:23,653 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-28 14:53:23,655 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:53:23,655 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-28 14:53:23,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:53:23,841 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:23,843 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-28 14:53:23,846 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-28 14:53:23,856 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-28 14:53:23,856 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-28 14:53:23,860 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41403%2C1701183201531.meta, suffix=.meta, logDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/WALs/jenkins-hbase4.apache.org,41403,1701183201531, archiveDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/oldWALs, maxLogs=32 2023-11-28 14:53:23,876 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42371,DS-f2107c6f-cedf-416e-9e5d-9b11c4dbf1f2,DISK] 2023-11-28 14:53:23,880 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/WALs/jenkins-hbase4.apache.org,41403,1701183201531/jenkins-hbase4.apache.org%2C41403%2C1701183201531.meta.1701183203861.meta 2023-11-28 14:53:23,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42371,DS-f2107c6f-cedf-416e-9e5d-9b11c4dbf1f2,DISK]] 2023-11-28 14:53:23,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:53:23,882 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-28 14:53:23,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-28 14:53:23,903 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-28 14:53:23,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-28 14:53:23,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:23,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-28 14:53:23,909 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-28 14:53:23,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-28 14:53:23,913 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/info 2023-11-28 14:53:23,913 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/info 2023-11-28 14:53:23,914 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-28 14:53:23,915 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:23,915 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-28 14:53:23,916 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/rep_barrier 2023-11-28 14:53:23,916 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/rep_barrier 2023-11-28 14:53:23,917 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-28 14:53:23,918 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:23,918 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-28 14:53:23,920 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/table 2023-11-28 14:53:23,920 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/table 2023-11-28 14:53:23,921 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-28 14:53:23,921 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:23,923 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740 2023-11-28 14:53:23,925 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740 2023-11-28 14:53:23,929 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-28 14:53:23,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-28 14:53:23,932 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70496580, jitterRate=0.05048090219497681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-28 14:53:23,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-28 14:53:23,941 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1701183203833 2023-11-28 14:53:23,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-28 14:53:23,960 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-28 14:53:23,960 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41403,1701183201531, state=OPEN 2023-11-28 14:53:23,966 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-28 14:53:23,967 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-28 14:53:23,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=3, resume processing ppid=2 2023-11-28 14:53:23,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41403,1701183201531 in 309 msec 2023-11-28 14:53:23,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=2, resume processing ppid=1 2023-11-28 14:53:23,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 497 msec 2023-11-28 14:53:23,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5070 sec 2023-11-28 14:53:23,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1701183203981, completionTime=-1 2023-11-28 14:53:23,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-28 14:53:23,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-28 14:53:24,045 DEBUG [hconnection-0x35b4b4bb-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:53:24,048 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:53:24,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-28 14:53:24,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1701183264065 2023-11-28 14:53:24,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1701183324065 2023-11-28 14:53:24,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 83 msec 2023-11-28 14:53:24,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35905,1701183200327-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:24,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35905,1701183200327-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:24,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35905,1701183200327-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:24,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35905, period=300000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:24,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-28 14:53:24,100 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-28 14:53:24,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-28 14:53:24,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-28 14:53:24,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-28 14:53:24,121 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:53:24,124 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:53:24,147 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:53:24,149 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49 empty. 2023-11-28 14:53:24,150 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:53:24,150 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-28 14:53:24,172 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-28 14:53:24,175 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 39f87ce083221dfe6b6ace19f8c17d49, NAME => 'hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:53:24,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:24,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 39f87ce083221dfe6b6ace19f8c17d49, disabling compactions & flushes 2023-11-28 14:53:24,186 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:53:24,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:53:24,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. after waiting 0 ms 2023-11-28 14:53:24,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:53:24,187 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:53:24,187 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 39f87ce083221dfe6b6ace19f8c17d49: 2023-11-28 14:53:24,191 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:53:24,206 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701183204194"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183204194"}]},"ts":"1701183204194"} 2023-11-28 14:53:24,231 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-28 14:53:24,233 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:53:24,237 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183204233"}]},"ts":"1701183204233"} 2023-11-28 14:53:24,242 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-28 14:53:24,251 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=39f87ce083221dfe6b6ace19f8c17d49, ASSIGN}] 2023-11-28 14:53:24,253 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=39f87ce083221dfe6b6ace19f8c17d49, ASSIGN 2023-11-28 14:53:24,255 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=39f87ce083221dfe6b6ace19f8c17d49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:53:24,406 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=39f87ce083221dfe6b6ace19f8c17d49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:24,406 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701183204406"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183204406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183204406"}]},"ts":"1701183204406"} 2023-11-28 14:53:24,411 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 39f87ce083221dfe6b6ace19f8c17d49, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:53:24,565 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:24,571 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:53:24,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39f87ce083221dfe6b6ace19f8c17d49, NAME => 'hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:53:24,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:53:24,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:24,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:53:24,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:53:24,575 INFO [StoreOpener-39f87ce083221dfe6b6ace19f8c17d49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:53:24,577 DEBUG [StoreOpener-39f87ce083221dfe6b6ace19f8c17d49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49/info 2023-11-28 14:53:24,577 DEBUG [StoreOpener-39f87ce083221dfe6b6ace19f8c17d49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49/info 2023-11-28 14:53:24,578 INFO [StoreOpener-39f87ce083221dfe6b6ace19f8c17d49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39f87ce083221dfe6b6ace19f8c17d49 columnFamilyName info 2023-11-28 14:53:24,579 INFO [StoreOpener-39f87ce083221dfe6b6ace19f8c17d49-1] regionserver.HStore(310): Store=39f87ce083221dfe6b6ace19f8c17d49/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:24,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:53:24,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:53:24,585 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:53:24,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:53:24,589 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 39f87ce083221dfe6b6ace19f8c17d49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58727143, jitterRate=-0.12489737570285797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:53:24,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 39f87ce083221dfe6b6ace19f8c17d49: 2023-11-28 14:53:24,592 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49., pid=6, masterSystemTime=1701183204565 2023-11-28 14:53:24,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:53:24,596 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:53:24,597 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=39f87ce083221dfe6b6ace19f8c17d49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:24,598 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701183204597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183204597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183204597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183204597"}]},"ts":"1701183204597"} 2023-11-28 14:53:24,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=6, resume processing ppid=5 2023-11-28 14:53:24,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 39f87ce083221dfe6b6ace19f8c17d49, server=jenkins-hbase4.apache.org,41403,1701183201531 in 191 msec 2023-11-28 14:53:24,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=5, resume processing ppid=4 2023-11-28 14:53:24,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=39f87ce083221dfe6b6ace19f8c17d49, ASSIGN in 354 msec 2023-11-28 14:53:24,611 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:53:24,611 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183204611"}]},"ts":"1701183204611"} 2023-11-28 14:53:24,614 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-28 14:53:24,618 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:53:24,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 508 msec 2023-11-28 14:53:24,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-28 14:53:24,623 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-28 14:53:24,623 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:53:24,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-28 14:53:24,676 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-28 14:53:24,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-11-28 14:53:24,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-28 14:53:24,707 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-28 14:53:24,712 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-11-28 14:53:24,723 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-28 14:53:24,726 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-28 14:53:24,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.117sec 2023-11-28 14:53:24,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-28 14:53:24,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-28 14:53:24,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-28 14:53:24,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35905,1701183200327-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-28 14:53:24,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35905,1701183200327-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-28 14:53:24,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-28 14:53:24,780 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(139): Connect 0x1ed63e4c to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:53:24,784 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f570f9f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:53:24,799 DEBUG [hconnection-0x1e5108ed-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:53:24,810 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:53:24,820 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:53:24,822 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(139): Connect 0x31f4d39e to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:53:24,828 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d52b92c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:53:24,828 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-28 14:53:24,881 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=362, ProcessCount=172, AvailableMemoryMB=7880 2023-11-28 14:53:24,892 DEBUG [Listener at localhost/45519] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:53:24,895 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:53:24,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-28 14:53:24,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:24,910 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:53:24,912 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:53:24,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-28 14:53:24,915 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:24,916 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a empty. 2023-11-28 14:53:24,918 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:24,918 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-28 14:53:24,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-28 14:53:25,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-28 14:53:25,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-28 14:53:25,335 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-28 14:53:25,337 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0d8b3179009e319055dc6b8e4ffb7b2a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:53:25,348 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:25,349 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 0d8b3179009e319055dc6b8e4ffb7b2a, disabling compactions & flushes 2023-11-28 14:53:25,349 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:25,349 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:25,349 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. after waiting 0 ms 2023-11-28 14:53:25,349 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:25,349 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:25,349 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:25,353 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:53:25,355 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701183205354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183205354"}]},"ts":"1701183205354"} 2023-11-28 14:53:25,357 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-28 14:53:25,359 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:53:25,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183205359"}]},"ts":"1701183205359"} 2023-11-28 14:53:25,361 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-28 14:53:25,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0d8b3179009e319055dc6b8e4ffb7b2a, ASSIGN}] 2023-11-28 14:53:25,368 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0d8b3179009e319055dc6b8e4ffb7b2a, ASSIGN 2023-11-28 14:53:25,369 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0d8b3179009e319055dc6b8e4ffb7b2a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:53:25,520 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0d8b3179009e319055dc6b8e4ffb7b2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:25,521 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701183205520"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183205520"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183205520"}]},"ts":"1701183205520"} 2023-11-28 14:53:25,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0d8b3179009e319055dc6b8e4ffb7b2a, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:53:25,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-28 14:53:25,678 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:25,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:25,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d8b3179009e319055dc6b8e4ffb7b2a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:53:25,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:25,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:25,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:25,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:25,688 INFO [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:25,691 DEBUG [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:25,691 DEBUG [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:25,695 INFO [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d8b3179009e319055dc6b8e4ffb7b2a columnFamilyName family1 2023-11-28 14:53:25,698 INFO [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] regionserver.HStore(310): Store=0d8b3179009e319055dc6b8e4ffb7b2a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:25,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:25,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:25,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:25,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:53:25,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d8b3179009e319055dc6b8e4ffb7b2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71063220, jitterRate=0.05892449617385864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:53:25,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:25,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a., pid=11, masterSystemTime=1701183205678 2023-11-28 14:53:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:25,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:25,718 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0d8b3179009e319055dc6b8e4ffb7b2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:25,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701183205718"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183205718"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183205718"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183205718"}]},"ts":"1701183205718"} 2023-11-28 14:53:25,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=11, resume processing ppid=10 2023-11-28 14:53:25,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0d8b3179009e319055dc6b8e4ffb7b2a, server=jenkins-hbase4.apache.org,41403,1701183201531 in 198 msec 2023-11-28 14:53:25,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=10, resume processing ppid=9 2023-11-28 14:53:25,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0d8b3179009e319055dc6b8e4ffb7b2a, ASSIGN in 360 msec 2023-11-28 14:53:25,731 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:53:25,731 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183205731"}]},"ts":"1701183205731"} 2023-11-28 14:53:25,733 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-28 14:53:25,736 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:53:25,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 830 msec 2023-11-28 14:53:26,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-28 14:53:26,036 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-28 14:53:26,053 DEBUG [hconnection-0x3691683a-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:53:26,056 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:53:26,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:26,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:26,232 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:26,232 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:26,232 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:26,233 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:26,233 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:26,233 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:26,236 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:26,236 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:26,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:26,237 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:26,237 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:26,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:26,238 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:26,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:26,240 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:26,240 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:26,241 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:26,241 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:26,242 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:26,241 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:26,243 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:26,244 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-28 14:53:26,799 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b0bd31db149c471f9aa3a2f588d458cc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b0bd31db149c471f9aa3a2f588d458cc 2023-11-28 14:53:27,218 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/ac141aa82a6e46008ba0938869f08c65 2023-11-28 14:53:27,229 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/ac141aa82a6e46008ba0938869f08c65 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/ac141aa82a6e46008ba0938869f08c65 2023-11-28 14:53:27,239 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/ac141aa82a6e46008ba0938869f08c65, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-28 14:53:27,243 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 999ms, sequenceid=5, compaction requested=false 2023-11-28 14:53:27,244 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:27,248 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:27,248 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:27,249 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:27,249 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:27,249 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,249 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:27,249 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:27,252 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,252 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:27,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,253 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:27,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:27,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:27,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:27,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:27,255 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:27,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d239f10[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:27,255 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,257 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:27,258 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,258 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:27,258 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:27,261 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,261 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:27,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:27,261 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:27,261 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:27,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:27,265 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:27,265 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:27,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:27,265 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:27,265 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,265 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:27,268 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,268 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,268 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:27,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:27,269 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,271 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,279 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,279 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,280 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:27,280 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:27,280 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:27,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:27,280 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,280 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,280 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,280 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:27,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:27,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:27,280 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:27,282 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:27,282 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:27,383 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:27,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:27,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:27,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:27,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,402 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:27,402 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:27,403 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:27,403 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:27,403 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,403 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,412 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:27,412 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:27,412 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,413 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:27,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,414 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,414 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-28 14:53:27,414 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,414 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:27,414 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:27,415 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:27,415 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:27,415 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:27,415 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:27,415 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:27,415 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-28 14:53:27,444 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128708364bd25034de6ab9ddfba1d693fa4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128708364bd25034de6ab9ddfba1d693fa4 2023-11-28 14:53:27,856 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/8bb408bfcfc349b5a8c77427368e0cf2 2023-11-28 14:53:27,866 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/8bb408bfcfc349b5a8c77427368e0cf2 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/8bb408bfcfc349b5a8c77427368e0cf2 2023-11-28 14:53:27,875 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/8bb408bfcfc349b5a8c77427368e0cf2, entries=1, sequenceid=9, filesize=5.0 K 2023-11-28 14:53:27,876 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 461ms, sequenceid=9, compaction requested=false 2023-11-28 14:53:27,877 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:27,877 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:27,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:27,881 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,881 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:27,881 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,881 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:27,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:27,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@570ec058[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:27,884 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:27,884 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,885 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,885 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:27,886 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:27,886 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:27,886 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,886 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:27,888 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:27,888 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,888 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:27,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:27,888 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:27,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:27,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:27,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:27,893 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:27,893 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:27,893 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:27,893 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,893 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:27,895 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,895 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:27,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:27,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,895 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:27,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:27,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:27,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:27,896 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,898 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:27,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:27,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:27,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:27,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:27,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:27,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,904 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:27,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:27,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:27,905 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:27,905 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:28,005 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:28,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:28,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:28,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:28,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,019 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:28,019 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:28,019 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:28,019 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:28,020 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,020 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,022 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:28,022 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:28,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:28,022 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,023 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:28,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,024 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,024 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-28 14:53:28,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,024 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:28,024 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:28,024 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:28,025 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:28,025 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:28,025 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:28,025 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:28,025 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:28,450 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e78366729f7a49e0a7cde4a136cee3a3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e78366729f7a49e0a7cde4a136cee3a3 2023-11-28 14:53:28,462 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/b583baa71b0c49efbf65e501925425e2 2023-11-28 14:53:28,472 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/b583baa71b0c49efbf65e501925425e2 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/b583baa71b0c49efbf65e501925425e2 2023-11-28 14:53:28,481 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/b583baa71b0c49efbf65e501925425e2, entries=1, sequenceid=13, filesize=5.0 K 2023-11-28 14:53:28,483 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 457ms, sequenceid=13, compaction requested=true 2023-11-28 14:53:28,483 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:28,483 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:28,483 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:28,483 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:28,483 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,483 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:28,483 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:28,486 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,486 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:28,487 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,487 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:28,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:28,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f31e90c[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:28,489 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:28,490 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,491 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,491 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:28,491 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:28,491 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:28,491 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,491 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:28,498 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,498 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:28,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:28,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:28,498 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:28,499 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:28,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:28,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:28,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:28,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:28,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:28,503 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:28,503 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:28,503 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:28,503 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,503 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:28,505 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,505 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,505 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:28,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:28,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:28,507 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:28,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,509 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:28,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:28,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:28,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:28,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:28,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:28,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:28,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,515 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:28,516 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:28,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:28,517 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:28,517 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:28,617 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:28,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:28,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:28,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:28,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,629 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:28,629 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:28,630 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:28,630 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:28,630 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,630 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,632 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:28,632 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:28,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:28,633 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,633 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:28,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:28,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,634 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,634 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-28 14:53:28,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:28,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:28,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:28,635 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:28,635 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:28,635 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:28,635 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:28,635 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:28,661 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205eee42fe2a00346ed97a1bc33566139ff to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205eee42fe2a00346ed97a1bc33566139ff 2023-11-28 14:53:28,666 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-28 14:53:28,672 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-28 14:53:28,674 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/e93936b357764300b6fd4d9234c260bf 2023-11-28 14:53:28,685 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/e93936b357764300b6fd4d9234c260bf as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/e93936b357764300b6fd4d9234c260bf 2023-11-28 14:53:28,693 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/e93936b357764300b6fd4d9234c260bf, entries=1, sequenceid=17, filesize=5.0 K 2023-11-28 14:53:28,695 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 60ms, sequenceid=17, compaction requested=true 2023-11-28 14:53:28,695 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:28,695 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:28,696 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:28,696 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,696 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:28,696 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:28,699 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,700 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:28,700 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,700 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:28,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:28,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12b2965e[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:28,703 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:28,703 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,705 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,705 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:28,705 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:28,705 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:28,706 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,706 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:28,707 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,707 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:28,708 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:28,708 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:28,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:28,712 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:28,712 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:28,712 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:28,712 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,712 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:28,717 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,717 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,717 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:28,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:28,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:28,718 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,720 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:28,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,724 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,724 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,724 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:28,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:28,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:28,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:28,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,725 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:28,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:28,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:28,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:28,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:28,726 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:28,726 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:28,827 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:28,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:28,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:28,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:28,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,839 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:28,839 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:28,839 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:28,839 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:28,840 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,840 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,842 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,842 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:28,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:28,842 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,842 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:28,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,843 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,843 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-28 14:53:28,844 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:28,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:28,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:28,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:28,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:28,844 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:28,844 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:28,845 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:28,867 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281206e8f5e17e49faa58363c95cf8b21a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512281206e8f5e17e49faa58363c95cf8b21a 2023-11-28 14:53:28,878 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/9fb9484605fa4f9cbf9ae16b5d89a4d4 2023-11-28 14:53:28,886 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/9fb9484605fa4f9cbf9ae16b5d89a4d4 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/9fb9484605fa4f9cbf9ae16b5d89a4d4 2023-11-28 14:53:28,894 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/9fb9484605fa4f9cbf9ae16b5d89a4d4, entries=1, sequenceid=21, filesize=5.0 K 2023-11-28 14:53:28,896 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 51ms, sequenceid=21, compaction requested=true 2023-11-28 14:53:28,896 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:28,896 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:28,896 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:28,897 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:28,897 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,897 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:28,897 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:28,899 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,899 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:28,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:28,899 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,900 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:28,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:28,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:28,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:28,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:28,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43385007[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:28,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:28,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,905 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:28,905 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:28,905 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:28,905 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,905 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:28,906 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:28,906 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:28,906 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:28,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:28,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:28,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:28,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:28,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:28,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:28,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:28,911 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:28,911 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:28,911 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:28,911 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,911 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:28,913 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,913 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:28,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,913 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:28,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:28,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:28,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:28,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:28,915 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:28,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,922 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:28,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,926 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,926 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:28,926 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:28,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:28,926 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:28,926 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,926 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:28,927 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:28,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:28,927 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:28,928 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:28,927 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:28,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:28,930 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:28,931 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:29,031 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:29,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:29,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:29,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:29,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,043 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:29,044 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:29,044 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:29,044 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:29,045 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,045 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,047 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:29,047 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:29,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:29,047 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,047 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:29,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-28 14:53:29,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,049 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:29,049 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:29,050 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:29,050 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:29,050 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:29,050 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:29,050 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:29,050 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:29,436 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:53:29,478 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312a050d125a3846d6b92f753007d8bd45 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312a050d125a3846d6b92f753007d8bd45 2023-11-28 14:53:29,490 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/2b902be596764bf7b2374b39c843a2de 2023-11-28 14:53:29,502 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/2b902be596764bf7b2374b39c843a2de as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/2b902be596764bf7b2374b39c843a2de 2023-11-28 14:53:29,511 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/2b902be596764bf7b2374b39c843a2de, entries=1, sequenceid=25, filesize=5.0 K 2023-11-28 14:53:29,513 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 463ms, sequenceid=25, compaction requested=true 2023-11-28 14:53:29,513 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:29,513 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:29,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:29,516 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:29,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:29,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62955438[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:29,519 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:29,519 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,521 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:29,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:29,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:29,522 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,522 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:29,523 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,524 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,524 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:29,524 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:29,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:29,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:29,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:29,528 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:29,528 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:29,529 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:29,529 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,529 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:29,531 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,531 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:29,531 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:29,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:29,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:29,532 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,535 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:29,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:29,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:29,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:29,538 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:29,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:29,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:29,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:29,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,539 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:29,539 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:29,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:29,639 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:29,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:29,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:29,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:29,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,651 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:29,652 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:29,652 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:29,652 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:29,653 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,653 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,655 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:29,655 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:29,656 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:29,656 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:29,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:29,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,658 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,658 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-28 14:53:29,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:29,658 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:29,658 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:29,659 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:29,659 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:29,659 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:29,659 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:29,659 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:29,659 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:30,085 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010a76c3c57edf4c28a70ae76c2beea794 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601010a76c3c57edf4c28a70ae76c2beea794 2023-11-28 14:53:30,492 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-28 14:53:30,493 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-28 14:53:30,495 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/a8f0a4e4e4ca4535b87ebe8e1dbeb88d 2023-11-28 14:53:30,505 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/a8f0a4e4e4ca4535b87ebe8e1dbeb88d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/a8f0a4e4e4ca4535b87ebe8e1dbeb88d 2023-11-28 14:53:30,514 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/a8f0a4e4e4ca4535b87ebe8e1dbeb88d, entries=1, sequenceid=29, filesize=5.0 K 2023-11-28 14:53:30,516 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 857ms, sequenceid=29, compaction requested=true 2023-11-28 14:53:30,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:30,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:30,523 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,523 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:30,524 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,524 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:30,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:30,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:30,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:30,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:30,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20cb8ef[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:30,526 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:30,526 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,528 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,528 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:30,528 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:30,528 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:30,528 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,528 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:30,531 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:30,531 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,531 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:30,531 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:30,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:30,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:30,535 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:30,535 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:30,535 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:30,535 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,535 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:30,537 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,537 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,537 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:30,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:30,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:30,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:30,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:30,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:30,538 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,540 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:30,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,544 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,544 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,544 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:30,544 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:30,544 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,544 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:30,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:30,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:30,544 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:30,544 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,545 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:30,545 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,545 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:30,545 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:30,646 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:30,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:30,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:30,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:30,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,657 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:30,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:30,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:30,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:30,659 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,659 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,661 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:30,661 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:30,661 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:30,661 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:30,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:30,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,662 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,663 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-28 14:53:30,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:30,663 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:30,663 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:30,663 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:30,663 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:30,663 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:30,663 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:30,664 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:30,664 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:31,087 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103368d953b5ba244b0826174ae0eb5cff1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103368d953b5ba244b0826174ae0eb5cff1 2023-11-28 14:53:31,499 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/1f079e7c9f184fb7907239aff4c08a87 2023-11-28 14:53:31,509 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/1f079e7c9f184fb7907239aff4c08a87 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/1f079e7c9f184fb7907239aff4c08a87 2023-11-28 14:53:31,516 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/1f079e7c9f184fb7907239aff4c08a87, entries=1, sequenceid=33, filesize=5.0 K 2023-11-28 14:53:31,517 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 853ms, sequenceid=33, compaction requested=true 2023-11-28 14:53:31,517 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:31,517 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:31,517 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:31,518 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:31,518 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,518 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:31,518 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:31,521 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:31,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:31,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:31,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:31,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:31,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:31,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48ade96[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:31,523 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:31,524 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,525 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,525 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:31,525 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:31,525 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:31,525 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,525 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:31,527 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:31,527 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,527 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:31,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:31,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:31,527 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:31,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:31,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:31,531 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:31,531 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:31,531 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:31,531 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,531 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:31,533 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,533 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,533 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:31,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:31,534 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:31,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,536 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,540 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:31,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:31,541 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:31,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:31,541 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,541 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-28 14:53:31,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:31,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:31,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:31,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:31,541 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:31,541 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,542 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,542 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,542 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,542 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,542 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:31,542 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:31,642 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:31,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:31,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:31,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:31,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,655 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:31,655 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:31,655 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:31,655 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:31,656 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,656 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,658 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:31,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:31,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:31,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:31,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:31,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:31,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,659 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,659 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-28 14:53:31,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:31,661 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:31,661 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:31,661 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:31,662 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:31,662 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:31,662 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:31,662 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:31,662 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:32,084 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090753e015c4ac3840ce9a5d881beb2ff36c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090753e015c4ac3840ce9a5d881beb2ff36c 2023-11-28 14:53:32,494 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/03bb5777cdb845d88d8fbf8043dc09e3 2023-11-28 14:53:32,503 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/03bb5777cdb845d88d8fbf8043dc09e3 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/03bb5777cdb845d88d8fbf8043dc09e3 2023-11-28 14:53:32,510 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/03bb5777cdb845d88d8fbf8043dc09e3, entries=1, sequenceid=37, filesize=5.0 K 2023-11-28 14:53:32,511 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 849ms, sequenceid=37, compaction requested=true 2023-11-28 14:53:32,511 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:32,511 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:32,511 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:32,514 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,514 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:32,514 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,514 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:32,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:32,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b31e68[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:32,516 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:32,517 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,518 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:32,519 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,519 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:32,522 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:32,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:32,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:32,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:32,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:32,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:32,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:32,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:32,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:32,526 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:32,526 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:32,526 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:32,526 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,526 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:32,529 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,529 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:32,529 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:32,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:32,530 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:32,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,532 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:32,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:32,538 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:32,538 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:32,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:32,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:32,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:32,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:32,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:32,540 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:32,540 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:32,640 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:32,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:32,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:32,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:32,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,654 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:32,654 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:32,655 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-28 14:53:32,655 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-28 14:53:32,656 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,656 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,658 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:32,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:32,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:32,659 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:32,659 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:32,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,661 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-28 14:53:32,661 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:32,661 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-28 14:53:32,661 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:32,662 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-28 14:53:32,663 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:32,663 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:32,663 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:32,663 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. started... 2023-11-28 14:53:32,663 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0d8b3179009e319055dc6b8e4ffb7b2a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:33,086 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b15f9d773814421e83fc785e3fc2ed3a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b15f9d773814421e83fc785e3fc2ed3a 2023-11-28 14:53:33,496 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/374f3b4c3cfb42869c35f8e9bd5f8136 2023-11-28 14:53:33,504 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/374f3b4c3cfb42869c35f8e9bd5f8136 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/374f3b4c3cfb42869c35f8e9bd5f8136 2023-11-28 14:53:33,511 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/374f3b4c3cfb42869c35f8e9bd5f8136, entries=1, sequenceid=41, filesize=5.0 K 2023-11-28 14:53:33,513 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0d8b3179009e319055dc6b8e4ffb7b2a in 850ms, sequenceid=41, compaction requested=true 2023-11-28 14:53:33,513 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:33,513 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:33,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:33,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:33,514 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,514 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-28 14:53:33,514 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-28 14:53:33,516 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:33,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:33,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:33,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:33,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-28 14:53:33,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dcfbe72[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:33,518 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-28 14:53:33,518 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,520 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-28 14:53:33,520 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-28 14:53:33,520 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:33,520 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,520 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:33,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-28 14:53:33,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:33,522 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-28 14:53:33,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:33,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:33,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:33,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:33,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:33,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-28 14:53:33,526 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-28 14:53:33,526 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:33,526 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:33,526 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,526 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:33,530 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,530 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:33,530 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:33,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:33,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,530 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:33,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:33,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:33,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:33,532 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:33,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:33,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:33,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:33,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:33,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-28 14:53:33,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:33,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-28 14:53:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:33,536 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:33,537 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:33,537 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:33,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:33,637 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:33,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:33,644 DEBUG [Listener at localhost/45519] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-28 14:53:33,648 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-28 14:53:33,649 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:33,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-28 14:53:33,665 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-28 14:53:33,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:53:33,666 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183813666 2023-11-28 14:53:33,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:53:33,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-28 14:53:33,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:33,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x3acbacdd to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:53:33,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ca27f49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:53:33,680 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:34,567 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034a289102111d4a8b94d1fb4db1a0813e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601034a289102111d4a8b94d1fb4db1a0813e 2023-11-28 14:53:34,568 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:34,587 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:53:34,589 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:53:34,602 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:53:34,604 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:53:34,646 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ec54d232d984492787b13abc22b9e4b0 first=Optional[r3] last=Optional[r6] 2023-11-28 14:53:34,665 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ec54d232d984492787b13abc22b9e4b0}] 2023-11-28 14:53:34,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ec54d232d984492787b13abc22b9e4b0 for inclusion in 0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:34,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-28 14:53:34,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:53:34,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:34,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ec54d232d984492787b13abc22b9e4b0 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__a1kdp774dmh47i1nhd38vjbocudt98pt7qbp41722vrahpl6kovs3lb66j2alfcm/family1/ec54d232d984492787b13abc22b9e4b0 2023-11-28 14:53:34,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__a1kdp774dmh47i1nhd38vjbocudt98pt7qbp41722vrahpl6kovs3lb66j2alfcm/family1/ec54d232d984492787b13abc22b9e4b0 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4f5b3d6680a34a33a60c250e52e32677_SeqId_44_ 2023-11-28 14:53:34,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__a1kdp774dmh47i1nhd38vjbocudt98pt7qbp41722vrahpl6kovs3lb66j2alfcm/family1/ec54d232d984492787b13abc22b9e4b0 into 0d8b3179009e319055dc6b8e4ffb7b2a/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4f5b3d6680a34a33a60c250e52e32677_SeqId_44_ - updating store file list. 2023-11-28 14:53:34,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4f5b3d6680a34a33a60c250e52e32677_SeqId_44_ into 0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:34,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__a1kdp774dmh47i1nhd38vjbocudt98pt7qbp41722vrahpl6kovs3lb66j2alfcm/family1/ec54d232d984492787b13abc22b9e4b0 into 0d8b3179009e319055dc6b8e4ffb7b2a/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4f5b3d6680a34a33a60c250e52e32677_SeqId_44_) 2023-11-28 14:53:34,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__a1kdp774dmh47i1nhd38vjbocudt98pt7qbp41722vrahpl6kovs3lb66j2alfcm/family1/ec54d232d984492787b13abc22b9e4b0 2023-11-28 14:53:34,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-28 14:53:34,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-28 14:53:34,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): 0d8b3179009e319055dc6b8e4ffb7b2a/family1 is initiating minor compaction 2023-11-28 14:53:34,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@bb838fa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:53:34,717 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0d8b3179009e319055dc6b8e4ffb7b2a/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:34,718 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/8bb408bfcfc349b5a8c77427368e0cf2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/b583baa71b0c49efbf65e501925425e2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/e93936b357764300b6fd4d9234c260bf, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/9fb9484605fa4f9cbf9ae16b5d89a4d4, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/2b902be596764bf7b2374b39c843a2de, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/a8f0a4e4e4ca4535b87ebe8e1dbeb88d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/1f079e7c9f184fb7907239aff4c08a87, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/03bb5777cdb845d88d8fbf8043dc09e3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/374f3b4c3cfb42869c35f8e9bd5f8136, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4f5b3d6680a34a33a60c250e52e32677_SeqId_44_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp, totalSize=50.2 K 2023-11-28 14:53:34,719 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 8bb408bfcfc349b5a8c77427368e0cf2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-28 14:53:34,719 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting b583baa71b0c49efbf65e501925425e2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-28 14:53:34,719 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting e93936b357764300b6fd4d9234c260bf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-28 14:53:34,719 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 9fb9484605fa4f9cbf9ae16b5d89a4d4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-28 14:53:34,720 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 2b902be596764bf7b2374b39c843a2de, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-28 14:53:34,720 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting a8f0a4e4e4ca4535b87ebe8e1dbeb88d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-28 14:53:34,720 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 1f079e7c9f184fb7907239aff4c08a87, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-28 14:53:34,720 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 03bb5777cdb845d88d8fbf8043dc09e3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-28 14:53:34,720 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 374f3b4c3cfb42869c35f8e9bd5f8136, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-28 14:53:34,720 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 4f5b3d6680a34a33a60c250e52e32677_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-28 14:53:34,736 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:34,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:34,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512281206e8f5e17e49faa58363c95cf8b21a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512281206e8f5e17e49faa58363c95cf8b21a 2023-11-28 14:53:34,746 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312a050d125a3846d6b92f753007d8bd45 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312a050d125a3846d6b92f753007d8bd45 2023-11-28 14:53:34,749 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601010a76c3c57edf4c28a70ae76c2beea794 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601010a76c3c57edf4c28a70ae76c2beea794 2023-11-28 14:53:34,750 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103368d953b5ba244b0826174ae0eb5cff1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103368d953b5ba244b0826174ae0eb5cff1 2023-11-28 14:53:34,750 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-28 14:53:34,751 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-28 14:53:34,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:34,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:34,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:34,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:34,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:34,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:34,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:34,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:34,781 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0d8b3179009e319055dc6b8e4ffb7b2a#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:53:35,611 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/6e41014175634c83add04f64abb7f9f5 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/6e41014175634c83add04f64abb7f9f5 2023-11-28 14:53:35,628 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0d8b3179009e319055dc6b8e4ffb7b2a/family1 of 0d8b3179009e319055dc6b8e4ffb7b2a into 6e41014175634c83add04f64abb7f9f5(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:53:35,629 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:35,630 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1701183214715; duration=0sec 2023-11-28 14:53:35,631 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:53:35,656 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e5db3129fa99444dbfac563e35440960 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e5db3129fa99444dbfac563e35440960 2023-11-28 14:53:35,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:35,691 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/08101c9888e24f89a3c5544da0c6d88e first=Optional[r00] last=Optional[r2] 2023-11-28 14:53:35,692 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/08101c9888e24f89a3c5544da0c6d88e}] 2023-11-28 14:53:35,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/08101c9888e24f89a3c5544da0c6d88e for inclusion in 0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:35,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-28 14:53:35,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:53:35,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:35,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/08101c9888e24f89a3c5544da0c6d88e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__la84c77hbpmlbfut3kd5g0mblqtt4ce59usaadtrgie6f3ofacduft503jr1hko3/family1/08101c9888e24f89a3c5544da0c6d88e 2023-11-28 14:53:35,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__la84c77hbpmlbfut3kd5g0mblqtt4ce59usaadtrgie6f3ofacduft503jr1hko3/family1/08101c9888e24f89a3c5544da0c6d88e as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4213114eee5c4071ac27c8a300ae00b6_SeqId_47_ 2023-11-28 14:53:35,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__la84c77hbpmlbfut3kd5g0mblqtt4ce59usaadtrgie6f3ofacduft503jr1hko3/family1/08101c9888e24f89a3c5544da0c6d88e into 0d8b3179009e319055dc6b8e4ffb7b2a/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4213114eee5c4071ac27c8a300ae00b6_SeqId_47_ - updating store file list. 2023-11-28 14:53:35,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/8bb408bfcfc349b5a8c77427368e0cf2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/b583baa71b0c49efbf65e501925425e2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/e93936b357764300b6fd4d9234c260bf, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/9fb9484605fa4f9cbf9ae16b5d89a4d4, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/2b902be596764bf7b2374b39c843a2de, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/a8f0a4e4e4ca4535b87ebe8e1dbeb88d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/1f079e7c9f184fb7907239aff4c08a87, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/03bb5777cdb845d88d8fbf8043dc09e3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/374f3b4c3cfb42869c35f8e9bd5f8136, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4f5b3d6680a34a33a60c250e52e32677_SeqId_44_] to archive 2023-11-28 14:53:35,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:35,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4213114eee5c4071ac27c8a300ae00b6_SeqId_47_ into 0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:35,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__la84c77hbpmlbfut3kd5g0mblqtt4ce59usaadtrgie6f3ofacduft503jr1hko3/family1/08101c9888e24f89a3c5544da0c6d88e into 0d8b3179009e319055dc6b8e4ffb7b2a/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4213114eee5c4071ac27c8a300ae00b6_SeqId_47_) 2023-11-28 14:53:35,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__la84c77hbpmlbfut3kd5g0mblqtt4ce59usaadtrgie6f3ofacduft503jr1hko3/family1/08101c9888e24f89a3c5544da0c6d88e 2023-11-28 14:53:35,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-28 14:53:35,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/8bb408bfcfc349b5a8c77427368e0cf2 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/8bb408bfcfc349b5a8c77427368e0cf2 2023-11-28 14:53:35,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-28 14:53:35,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): 0d8b3179009e319055dc6b8e4ffb7b2a/family1 is initiating minor compaction (all files) 2023-11-28 14:53:35,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5d61fcc9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:53:35,730 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0d8b3179009e319055dc6b8e4ffb7b2a/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:35,731 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/ac141aa82a6e46008ba0938869f08c65, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/6e41014175634c83add04f64abb7f9f5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4213114eee5c4071ac27c8a300ae00b6_SeqId_47_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp, totalSize=358.6 K 2023-11-28 14:53:35,732 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting ac141aa82a6e46008ba0938869f08c65, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824829 2023-11-28 14:53:35,733 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 6e41014175634c83add04f64abb7f9f5, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224829 2023-11-28 14:53:35,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/b583baa71b0c49efbf65e501925425e2 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/b583baa71b0c49efbf65e501925425e2 2023-11-28 14:53:35,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:35,734 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 4213114eee5c4071ac27c8a300ae00b6_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824829 2023-11-28 14:53:35,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:35,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/e93936b357764300b6fd4d9234c260bf to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/e93936b357764300b6fd4d9234c260bf 2023-11-28 14:53:35,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b0bd31db149c471f9aa3a2f588d458cc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130b0bd31db149c471f9aa3a2f588d458cc 2023-11-28 14:53:35,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/9fb9484605fa4f9cbf9ae16b5d89a4d4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/9fb9484605fa4f9cbf9ae16b5d89a4d4 2023-11-28 14:53:35,743 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e78366729f7a49e0a7cde4a136cee3a3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201e78366729f7a49e0a7cde4a136cee3a3 2023-11-28 14:53:35,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/2b902be596764bf7b2374b39c843a2de to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/2b902be596764bf7b2374b39c843a2de 2023-11-28 14:53:35,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205eee42fe2a00346ed97a1bc33566139ff to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205eee42fe2a00346ed97a1bc33566139ff 2023-11-28 14:53:35,745 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-28 14:53:35,745 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-28 14:53:35,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:35,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:35,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:53:35,747 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-28 14:53:35,748 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/a8f0a4e4e4ca4535b87ebe8e1dbeb88d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/a8f0a4e4e4ca4535b87ebe8e1dbeb88d 2023-11-28 14:53:35,750 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0920 sec 2023-11-28 14:53:35,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/1f079e7c9f184fb7907239aff4c08a87 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/1f079e7c9f184fb7907239aff4c08a87 2023-11-28 14:53:35,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/03bb5777cdb845d88d8fbf8043dc09e3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/03bb5777cdb845d88d8fbf8043dc09e3 2023-11-28 14:53:35,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/374f3b4c3cfb42869c35f8e9bd5f8136 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/374f3b4c3cfb42869c35f8e9bd5f8136 2023-11-28 14:53:35,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4f5b3d6680a34a33a60c250e52e32677_SeqId_44_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4f5b3d6680a34a33a60c250e52e32677_SeqId_44_ 2023-11-28 14:53:35,781 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0d8b3179009e319055dc6b8e4ffb7b2a#family1#compaction#11 average throughput is 6.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:53:35,850 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/.tmp/family1/213b14c90b554a7e973bcc678acbe54f as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/213b14c90b554a7e973bcc678acbe54f 2023-11-28 14:53:35,861 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0d8b3179009e319055dc6b8e4ffb7b2a/family1 of 0d8b3179009e319055dc6b8e4ffb7b2a into 213b14c90b554a7e973bcc678acbe54f(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:53:35,861 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:35,862 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1701183215730; duration=0sec 2023-11-28 14:53:35,862 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:53:35,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/ac141aa82a6e46008ba0938869f08c65, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/6e41014175634c83add04f64abb7f9f5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4213114eee5c4071ac27c8a300ae00b6_SeqId_47_] to archive 2023-11-28 14:53:35,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:35,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/ac141aa82a6e46008ba0938869f08c65 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/ac141aa82a6e46008ba0938869f08c65 2023-11-28 14:53:35,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/6e41014175634c83add04f64abb7f9f5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/6e41014175634c83add04f64abb7f9f5 2023-11-28 14:53:35,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4213114eee5c4071ac27c8a300ae00b6_SeqId_47_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/4213114eee5c4071ac27c8a300ae00b6_SeqId_47_ 2023-11-28 14:53:35,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-28 14:53:35,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:35,972 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-28 14:53:35,974 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-28 14:53:35,974 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-28 14:53:35,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-28 14:53:35,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0d8b3179009e319055dc6b8e4ffb7b2a, REOPEN/MOVE}] 2023-11-28 14:53:36,001 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0d8b3179009e319055dc6b8e4ffb7b2a, REOPEN/MOVE 2023-11-28 14:53:36,002 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0d8b3179009e319055dc6b8e4ffb7b2a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:36,002 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701183216002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183216002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183216002"}]},"ts":"1701183216002"} 2023-11-28 14:53:36,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 0d8b3179009e319055dc6b8e4ffb7b2a, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:53:36,163 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:36,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:36,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d8b3179009e319055dc6b8e4ffb7b2a, disabling compactions & flushes 2023-11-28 14:53:36,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:36,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:36,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. after waiting 0 ms 2023-11-28 14:53:36,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:36,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-28 14:53:36,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:36,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:36,174 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 0d8b3179009e319055dc6b8e4ffb7b2a to self. 2023-11-28 14:53:36,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:36,178 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0d8b3179009e319055dc6b8e4ffb7b2a, regionState=CLOSED 2023-11-28 14:53:36,178 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701183216178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183216178"}]},"ts":"1701183216178"} 2023-11-28 14:53:36,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=16, resume processing ppid=15 2023-11-28 14:53:36,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 0d8b3179009e319055dc6b8e4ffb7b2a, server=jenkins-hbase4.apache.org,41403,1701183201531 in 176 msec 2023-11-28 14:53:36,185 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0d8b3179009e319055dc6b8e4ffb7b2a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=true 2023-11-28 14:53:36,336 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0d8b3179009e319055dc6b8e4ffb7b2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:36,336 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701183216335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183216335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183216335"}]},"ts":"1701183216335"} 2023-11-28 14:53:36,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 0d8b3179009e319055dc6b8e4ffb7b2a, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:53:36,492 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:36,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:36,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d8b3179009e319055dc6b8e4ffb7b2a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:53:36,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:36,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:36,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:36,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:36,532 INFO [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:36,536 DEBUG [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:36,538 DEBUG [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:36,538 INFO [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d8b3179009e319055dc6b8e4ffb7b2a columnFamilyName family1 2023-11-28 14:53:36,538 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:53:36,539 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3acbacdd to 127.0.0.1:62725 2023-11-28 14:53:36,539 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:53:36,548 DEBUG [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/213b14c90b554a7e973bcc678acbe54f 2023-11-28 14:53:36,549 INFO [StoreOpener-0d8b3179009e319055dc6b8e4ffb7b2a-1] regionserver.HStore(310): Store=0d8b3179009e319055dc6b8e4ffb7b2a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:36,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:36,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:36,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:53:36,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d8b3179009e319055dc6b8e4ffb7b2a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63717571, jitterRate=-0.0505342036485672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:53:36,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:36,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a., pid=17, masterSystemTime=1701183216492 2023-11-28 14:53:36,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:36,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:53:36,561 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0d8b3179009e319055dc6b8e4ffb7b2a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:36,561 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701183216561"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183216561"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183216561"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183216561"}]},"ts":"1701183216561"} 2023-11-28 14:53:36,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=17, resume processing ppid=15 2023-11-28 14:53:36,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 0d8b3179009e319055dc6b8e4ffb7b2a, server=jenkins-hbase4.apache.org,41403,1701183201531 in 224 msec 2023-11-28 14:53:36,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=15, resume processing ppid=14 2023-11-28 14:53:36,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0d8b3179009e319055dc6b8e4ffb7b2a, REOPEN/MOVE in 566 msec 2023-11-28 14:53:36,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=14, resume processing ppid=13 2023-11-28 14:53:36,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 591 msec 2023-11-28 14:53:36,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 622 msec 2023-11-28 14:53:36,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-28 14:53:36,584 INFO [Listener at localhost/45519] compactions.TestMobCompactor(278): alter status finished 2023-11-28 14:53:36,585 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-28 14:53:36,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-28 14:53:36,588 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-28 14:53:36,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:53:36,589 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183816589 2023-11-28 14:53:36,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:53:36,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-28 14:53:36,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:36,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x32a82889 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:53:36,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@138a2d26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:53:36,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:36,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:36,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:36,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:36,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:37,439 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112860cc46b5dc594c068b0d0c064431593c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112860cc46b5dc594c068b0d0c064431593c 2023-11-28 14:53:37,440 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:37,457 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:53:37,459 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:53:37,467 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:53:37,469 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:53:37,482 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7d0db868215145e78c811b6b9976f89c first=Optional[r05] last=Optional[r8] 2023-11-28 14:53:37,482 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=51 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7d0db868215145e78c811b6b9976f89c}] 2023-11-28 14:53:37,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7d0db868215145e78c811b6b9976f89c for inclusion in 0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:37,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-28 14:53:37,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:53:37,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:53:37,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7d0db868215145e78c811b6b9976f89c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8s73rd5s207nfliaklmqat3tfmhu6bbrl0o6londa8psk8ei0o4rmijdtr8eclf/family1/7d0db868215145e78c811b6b9976f89c 2023-11-28 14:53:37,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8s73rd5s207nfliaklmqat3tfmhu6bbrl0o6londa8psk8ei0o4rmijdtr8eclf/family1/7d0db868215145e78c811b6b9976f89c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/5e252b297ef7458186937a4657301db8_SeqId_53_ 2023-11-28 14:53:37,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8s73rd5s207nfliaklmqat3tfmhu6bbrl0o6londa8psk8ei0o4rmijdtr8eclf/family1/7d0db868215145e78c811b6b9976f89c into 0d8b3179009e319055dc6b8e4ffb7b2a/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/5e252b297ef7458186937a4657301db8_SeqId_53_ - updating store file list. 2023-11-28 14:53:37,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/5e252b297ef7458186937a4657301db8_SeqId_53_ into 0d8b3179009e319055dc6b8e4ffb7b2a/family1 2023-11-28 14:53:37,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8s73rd5s207nfliaklmqat3tfmhu6bbrl0o6londa8psk8ei0o4rmijdtr8eclf/family1/7d0db868215145e78c811b6b9976f89c into 0d8b3179009e319055dc6b8e4ffb7b2a/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/family1/5e252b297ef7458186937a4657301db8_SeqId_53_) 2023-11-28 14:53:37,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e8s73rd5s207nfliaklmqat3tfmhu6bbrl0o6londa8psk8ei0o4rmijdtr8eclf/family1/7d0db868215145e78c811b6b9976f89c 2023-11-28 14:53:37,509 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:37,510 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:37,512 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b15f9d773814421e83fc785e3fc2ed3a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b15f9d773814421e83fc785e3fc2ed3a 2023-11-28 14:53:37,513 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128708364bd25034de6ab9ddfba1d693fa4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128708364bd25034de6ab9ddfba1d693fa4 2023-11-28 14:53:37,513 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-28 14:53:37,513 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-28 14:53:37,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:37,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:37,514 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-28 14:53:37,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-28 14:53:37,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:53:37,515 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-28 14:53:37,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 929 msec 2023-11-28 14:53:37,602 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=244 (was 214) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:41403-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43470 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135076928_17 at /127.0.0.1:46714 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62725@0x32a82889 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/359756548.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/cluster_bd31adab-41c5-d4fc-580e-11c102568516/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43328 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43330 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24c02cef-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24c02cef-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43266 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43376 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62725@0x32a82889-SendThread(127.0.0.1:62725) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43316 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62725@0x32a82889-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/cluster_bd31adab-41c5-d4fc-580e-11c102568516/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43358 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43224 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43344 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43414 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43276 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:43374 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x24c02cef-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=605 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=324 (was 362), ProcessCount=172 (was 172), AvailableMemoryMB=7783 (was 7880) 2023-11-28 14:53:37,617 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=244, OpenFileDescriptor=605, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=172, AvailableMemoryMB=7782 2023-11-28 14:53:37,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-28 14:53:37,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:37,624 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:53:37,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-28 14:53:37,625 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:53:37,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-28 14:53:37,626 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:53:37,627 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155 empty. 2023-11-28 14:53:37,628 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:53:37,628 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-28 14:53:37,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-28 14:53:37,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-28 14:53:38,040 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-28 14:53:38,041 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9bb0b6cc0ca47b17cc23194994ed6155, NAME => 'testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:53:38,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-28 14:53:38,448 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:38,449 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 9bb0b6cc0ca47b17cc23194994ed6155, disabling compactions & flushes 2023-11-28 14:53:38,449 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:38,449 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:38,449 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. after waiting 0 ms 2023-11-28 14:53:38,449 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:38,449 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:38,449 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:38,452 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:53:38,453 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701183218453"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183218453"}]},"ts":"1701183218453"} 2023-11-28 14:53:38,456 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-28 14:53:38,457 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:53:38,457 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183218457"}]},"ts":"1701183218457"} 2023-11-28 14:53:38,459 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-28 14:53:38,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=9bb0b6cc0ca47b17cc23194994ed6155, ASSIGN}] 2023-11-28 14:53:38,465 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=9bb0b6cc0ca47b17cc23194994ed6155, ASSIGN 2023-11-28 14:53:38,466 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=9bb0b6cc0ca47b17cc23194994ed6155, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:53:38,617 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9bb0b6cc0ca47b17cc23194994ed6155, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:38,618 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701183218617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183218617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183218617"}]},"ts":"1701183218617"} 2023-11-28 14:53:38,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 9bb0b6cc0ca47b17cc23194994ed6155, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:53:38,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-28 14:53:38,772 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:38,777 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:38,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9bb0b6cc0ca47b17cc23194994ed6155, NAME => 'testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:53:38,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:53:38,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:38,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:53:38,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:53:38,779 INFO [StoreOpener-9bb0b6cc0ca47b17cc23194994ed6155-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:53:38,781 DEBUG [StoreOpener-9bb0b6cc0ca47b17cc23194994ed6155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1 2023-11-28 14:53:38,781 DEBUG [StoreOpener-9bb0b6cc0ca47b17cc23194994ed6155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1 2023-11-28 14:53:38,781 INFO [StoreOpener-9bb0b6cc0ca47b17cc23194994ed6155-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9bb0b6cc0ca47b17cc23194994ed6155 columnFamilyName family1 2023-11-28 14:53:38,783 INFO [StoreOpener-9bb0b6cc0ca47b17cc23194994ed6155-1] regionserver.HStore(310): Store=9bb0b6cc0ca47b17cc23194994ed6155/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:38,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:53:38,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:53:38,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:53:38,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:53:38,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9bb0b6cc0ca47b17cc23194994ed6155; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59175486, jitterRate=-0.11821654438972473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:53:38,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:38,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155., pid=21, masterSystemTime=1701183218772 2023-11-28 14:53:38,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:38,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:38,795 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9bb0b6cc0ca47b17cc23194994ed6155, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:38,795 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701183218795"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183218795"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183218795"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183218795"}]},"ts":"1701183218795"} 2023-11-28 14:53:38,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=21, resume processing ppid=20 2023-11-28 14:53:38,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 9bb0b6cc0ca47b17cc23194994ed6155, server=jenkins-hbase4.apache.org,41403,1701183201531 in 177 msec 2023-11-28 14:53:38,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=20, resume processing ppid=19 2023-11-28 14:53:38,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=9bb0b6cc0ca47b17cc23194994ed6155, ASSIGN in 336 msec 2023-11-28 14:53:38,802 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:53:38,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183218802"}]},"ts":"1701183218802"} 2023-11-28 14:53:38,804 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-28 14:53:38,807 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:53:38,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1870 sec 2023-11-28 14:53:39,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-28 14:53:39,733 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-28 14:53:39,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:39,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:39,774 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:39,774 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:39,775 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:39,775 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:39,775 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:39,775 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:39,830 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:39,831 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:39,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:39,831 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:39,831 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:39,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:39,832 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:39,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:39,833 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:39,833 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:39,834 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:39,834 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:39,834 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:39,834 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-28 14:53:40,265 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305efda4c12f75442f83d9c9806212199c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511305efda4c12f75442f83d9c9806212199c 2023-11-28 14:53:40,670 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/0979e599113a4287bea245461eaa0815 2023-11-28 14:53:40,677 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:40,678 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/0979e599113a4287bea245461eaa0815 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/0979e599113a4287bea245461eaa0815 2023-11-28 14:53:40,684 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/0979e599113a4287bea245461eaa0815, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-28 14:53:40,685 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 851ms, sequenceid=5, compaction requested=false 2023-11-28 14:53:40,686 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:40,686 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:40,686 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,746 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:40,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,746 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:40,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:40,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:40,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:40,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:40,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a63bce4[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:40,748 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:40,749 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,785 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:40,785 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,785 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:40,832 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:40,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:40,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:40,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:40,836 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:40,836 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:40,837 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:40,837 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,837 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:40,877 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,877 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,877 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:40,877 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:40,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,879 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:40,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,969 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,969 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:40,969 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:40,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:40,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-28 14:53:40,969 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:40,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:40,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:40,969 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:40,970 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,970 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:40,970 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,971 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,971 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:40,971 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:40,971 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:40,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:40,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:41,071 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:41,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:41,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:41,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:41,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,080 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:41,080 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:41,081 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:41,081 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:41,081 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,081 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,115 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,115 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:41,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:41,116 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,116 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:41,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,117 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,117 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:53:41,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,117 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:41,117 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:41,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:41,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:41,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:41,118 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:41,118 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:41,118 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-28 14:53:41,535 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112805fa9466833c4f059e5fa1fb8f28e7e5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112805fa9466833c4f059e5fa1fb8f28e7e5 2023-11-28 14:53:41,707 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:53:41,941 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/837cae47abdc440aa0e087a75bac2144 2023-11-28 14:53:41,948 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/837cae47abdc440aa0e087a75bac2144 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/837cae47abdc440aa0e087a75bac2144 2023-11-28 14:53:41,954 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/837cae47abdc440aa0e087a75bac2144, entries=1, sequenceid=9, filesize=5.0 K 2023-11-28 14:53:41,955 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 837ms, sequenceid=9, compaction requested=false 2023-11-28 14:53:41,955 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:41,955 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:41,955 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:41,955 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:41,955 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,956 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:41,956 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:41,957 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,957 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,958 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:41,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:41,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:41,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78cfa950[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:41,960 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:41,960 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,963 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:41,963 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:41,963 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,963 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:41,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:41,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:41,965 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:41,965 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:41,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:41,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:41,969 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:41,969 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:41,969 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:41,969 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,969 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:41,971 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,971 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:41,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,971 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:41,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:41,972 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,974 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,977 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:41,977 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:41,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:41,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:41,977 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,977 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:41,977 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:41,978 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,978 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:41,978 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:41,979 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:41,978 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,979 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:41,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:41,979 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,079 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:42,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:42,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:42,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:42,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,088 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:42,088 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:42,089 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:42,089 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:42,089 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,089 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,092 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,092 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:42,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:42,092 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,092 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,093 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,093 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:53:42,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:42,094 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:42,094 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:42,095 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:42,513 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201179d6022481547b8a9d9f22a63624f53 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201179d6022481547b8a9d9f22a63624f53 2023-11-28 14:53:42,919 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/08c32f99ef5648f086198b2fe732adf1 2023-11-28 14:53:42,926 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/08c32f99ef5648f086198b2fe732adf1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/08c32f99ef5648f086198b2fe732adf1 2023-11-28 14:53:42,932 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/08c32f99ef5648f086198b2fe732adf1, entries=1, sequenceid=13, filesize=4.9 K 2023-11-28 14:53:42,933 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 838ms, sequenceid=13, compaction requested=true 2023-11-28 14:53:42,933 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:42,933 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:42,933 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:42,933 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:42,933 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,934 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:42,934 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:42,935 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,935 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:42,936 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,936 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:42,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:42,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6512a87f[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:42,938 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:42,938 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,939 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,940 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:42,940 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:42,940 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:42,940 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,940 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:42,941 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:42,941 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:42,941 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,941 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:42,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:42,945 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:42,945 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:42,945 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:42,945 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,945 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:42,947 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,947 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,948 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:42,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:42,948 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:42,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,950 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,952 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,952 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,952 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,953 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:42,953 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,953 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,953 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:42,953 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:42,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:42,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:42,953 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:42,953 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:42,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:42,954 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:42,954 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:42,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:43,054 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:43,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:43,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:43,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:43,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,063 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:43,063 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:43,063 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:43,064 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:43,064 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,064 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,066 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:43,066 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:43,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:43,066 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,067 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:43,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:43,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,067 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,068 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:53:43,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:43,069 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:43,069 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:43,069 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:43,069 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:43,069 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:43,488 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120512ab0305fcbc459bb093260ea120ceff to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120512ab0305fcbc459bb093260ea120ceff 2023-11-28 14:53:43,896 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/959c79c093ec4c28ab5f6beda785aab9 2023-11-28 14:53:43,902 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/959c79c093ec4c28ab5f6beda785aab9 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/959c79c093ec4c28ab5f6beda785aab9 2023-11-28 14:53:43,907 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/959c79c093ec4c28ab5f6beda785aab9, entries=1, sequenceid=17, filesize=4.9 K 2023-11-28 14:53:43,909 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 840ms, sequenceid=17, compaction requested=true 2023-11-28 14:53:43,909 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:43,909 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:43,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:43,911 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,911 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:43,912 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,912 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:43,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:43,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:43,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:43,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:43,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@551eb681[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:43,913 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:43,913 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,915 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,916 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:43,916 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:43,916 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:43,916 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,916 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:43,922 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,922 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:43,923 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:43,923 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:43,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:43,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:43,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:43,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:43,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:43,926 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:43,927 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:43,927 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:43,927 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,927 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:43,929 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,929 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:43,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:43,929 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:43,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:43,929 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:43,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:43,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:43,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,931 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:43,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,934 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,934 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,934 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,934 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:43,934 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:43,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:43,935 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:43,934 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:43,935 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,935 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:43,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:43,935 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:43,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:43,936 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:43,936 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:43,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:43,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:44,036 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:44,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:44,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:44,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:44,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,044 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:44,044 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:44,045 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:44,045 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:44,045 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,045 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,047 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,047 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:44,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:44,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:44,047 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,047 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:44,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:44,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:53:44,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,049 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:44,049 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:44,050 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:44,050 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:44,050 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:44,050 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:44,050 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:44,050 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:44,467 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122885aab566de4a42f284f40aa81fffe7ab to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122885aab566de4a42f284f40aa81fffe7ab 2023-11-28 14:53:44,873 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/b01ae34ddaba42518311092b4d466771 2023-11-28 14:53:44,879 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/b01ae34ddaba42518311092b4d466771 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/b01ae34ddaba42518311092b4d466771 2023-11-28 14:53:44,885 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/b01ae34ddaba42518311092b4d466771, entries=1, sequenceid=21, filesize=4.9 K 2023-11-28 14:53:44,886 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 836ms, sequenceid=21, compaction requested=true 2023-11-28 14:53:44,886 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:44,886 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:44,889 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,889 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:44,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:44,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:44,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62ada45a[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:44,892 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:44,892 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,893 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,893 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:44,893 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:44,893 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:44,893 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,893 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:44,895 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:44,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:44,898 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:44,898 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:44,898 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:44,898 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,898 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:44,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:44,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:44,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:44,901 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:44,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,906 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,906 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:44,906 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:44,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:44,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:44,906 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:44,906 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,906 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:44,907 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:44,907 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:44,907 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,907 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:44,907 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,908 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:44,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:44,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:45,008 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:45,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:45,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:45,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:45,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,016 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:45,016 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:45,017 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:45,017 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:45,017 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,017 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,019 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,019 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:45,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:45,019 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,019 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:45,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,020 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,020 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:53:45,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:45,021 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:45,021 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:45,021 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:45,036 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316a0e235d139f46709f0cdbf148286a29 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512316a0e235d139f46709f0cdbf148286a29 2023-11-28 14:53:45,443 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/26de36f90d644341bf604ed9545a239b 2023-11-28 14:53:45,450 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/26de36f90d644341bf604ed9545a239b as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/26de36f90d644341bf604ed9545a239b 2023-11-28 14:53:45,455 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/26de36f90d644341bf604ed9545a239b, entries=1, sequenceid=25, filesize=4.9 K 2023-11-28 14:53:45,456 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 435ms, sequenceid=25, compaction requested=true 2023-11-28 14:53:45,456 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:45,456 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:45,456 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:45,457 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:45,457 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,457 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:45,457 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:45,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,458 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:45,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:45,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67ad0476[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:45,461 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:45,461 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,462 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:45,463 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,463 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:45,470 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:45,470 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,470 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:45,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:45,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:45,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:45,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:45,474 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:45,475 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:45,475 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:45,475 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,475 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:45,476 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,477 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:45,477 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:45,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:45,477 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,479 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,481 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,481 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,481 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:45,482 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:45,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:45,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:45,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:45,482 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,482 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,482 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,482 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,482 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:45,482 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:45,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:45,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-28 14:53:45,482 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:45,483 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:45,583 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:45,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:45,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:45,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:45,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,590 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:45,591 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:45,591 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:45,591 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:45,592 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,592 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,593 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,593 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:45,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:45,593 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:45,593 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,594 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,595 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:53:45,595 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:45,595 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:45,595 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:45,595 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:45,595 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:45,595 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:45,595 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:45,595 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:45,596 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:46,012 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013d2932c13b9f498fa0b3195b6dcd32ba to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601013d2932c13b9f498fa0b3195b6dcd32ba 2023-11-28 14:53:46,418 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/8fd8dc505ffc4125a909065960363c93 2023-11-28 14:53:46,425 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/8fd8dc505ffc4125a909065960363c93 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/8fd8dc505ffc4125a909065960363c93 2023-11-28 14:53:46,430 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/8fd8dc505ffc4125a909065960363c93, entries=1, sequenceid=29, filesize=4.9 K 2023-11-28 14:53:46,431 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 835ms, sequenceid=29, compaction requested=true 2023-11-28 14:53:46,431 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:46,431 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:46,431 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:46,508 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,508 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:46,509 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,509 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:46,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:46,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@170c19ac[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:46,511 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:46,511 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,542 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,542 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:46,542 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:46,542 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:46,542 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,542 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:46,596 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:46,596 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,596 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:46,596 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:46,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:46,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:46,600 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:46,600 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:46,600 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:46,600 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,600 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:46,657 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,657 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:46,658 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:46,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:46,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,660 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,681 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,681 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:46,681 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:46,681 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:46,681 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:46,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:46,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:46,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:46,681 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,682 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,682 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,682 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,682 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,682 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:46,682 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:46,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:46,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:46,783 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:46,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:46,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:46,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:46,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,792 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:46,792 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:46,793 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:46,793 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:46,793 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,793 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,795 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:46,795 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:46,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:46,795 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:46,795 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:46,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:46,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,796 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,797 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:53:46,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:46,797 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:46,797 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:46,797 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:46,797 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:46,797 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:46,798 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:46,798 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:46,798 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:47,215 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037dda4ff4c6ee468cb4edb4db79838ae6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601037dda4ff4c6ee468cb4edb4db79838ae6 2023-11-28 14:53:47,221 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/9219fdcd9988462b85c30337c8807cb6 2023-11-28 14:53:47,227 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/9219fdcd9988462b85c30337c8807cb6 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/9219fdcd9988462b85c30337c8807cb6 2023-11-28 14:53:47,232 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/9219fdcd9988462b85c30337c8807cb6, entries=1, sequenceid=33, filesize=4.9 K 2023-11-28 14:53:47,233 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 435ms, sequenceid=33, compaction requested=true 2023-11-28 14:53:47,233 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:47,233 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:47,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:47,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:47,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:47,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:47,236 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,236 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:47,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:47,237 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,237 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:47,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:47,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37060f72[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:47,238 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:47,238 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,240 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,240 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:47,240 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:47,240 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:47,240 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,240 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:47,242 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,242 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:47,242 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:47,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:47,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:47,242 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:47,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:47,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:47,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:47,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:47,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:47,245 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:47,245 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:47,245 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:47,245 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,245 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:47,247 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,247 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:47,247 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:47,248 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,249 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,252 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,252 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,252 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:47,252 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:47,252 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,252 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:47,253 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:47,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:47,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:47,253 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:47,253 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,253 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,253 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:47,254 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:47,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:47,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:47,354 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:47,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:47,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:47,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,363 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:47,363 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:47,363 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:47,363 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:47,364 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,364 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,366 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:47,366 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:47,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:47,366 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,367 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:47,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:47,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,367 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,367 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:53:47,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:47,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:47,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:47,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:47,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:47,368 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:47,368 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:47,368 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:47,383 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079ed7151dd5094a2ba512405c51299269 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509079ed7151dd5094a2ba512405c51299269 2023-11-28 14:53:47,789 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/befb4281711544f88b77e8a35308de77 2023-11-28 14:53:47,795 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/befb4281711544f88b77e8a35308de77 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/befb4281711544f88b77e8a35308de77 2023-11-28 14:53:47,800 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/befb4281711544f88b77e8a35308de77, entries=1, sequenceid=37, filesize=4.9 K 2023-11-28 14:53:47,801 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 433ms, sequenceid=37, compaction requested=true 2023-11-28 14:53:47,801 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:47,802 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:47,802 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:47,802 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:47,802 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,802 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:47,802 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:47,805 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,805 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:47,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:47,805 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,805 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:47,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:47,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:47,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:47,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:47,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3886e2bc[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:47,806 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:47,806 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,808 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:47,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:47,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:47,808 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,808 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:47,809 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,810 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:47,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:47,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:47,810 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:47,810 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:47,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:47,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:47,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:47,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:47,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:47,813 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:47,813 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:47,813 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:47,813 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,813 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:47,815 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,815 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:47,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:47,815 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:47,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:47,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:47,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:47,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,816 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:47,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,817 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:47,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,824 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,824 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:47,824 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:47,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:47,824 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:47,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:47,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:47,824 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:47,824 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,825 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:47,825 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:47,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:47,825 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,825 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:47,825 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,826 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,926 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:47,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:47,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:47,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:47,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,933 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:47,933 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:47,934 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:53:47,934 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:47,934 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,934 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,936 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:47,936 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:47,936 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,936 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:47,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,937 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,937 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:53:47,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:53:47,937 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:53:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:47,939 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:47,939 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:47,939 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. started... 2023-11-28 14:53:47,939 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9bb0b6cc0ca47b17cc23194994ed6155 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:48,354 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204420872606e54d28a9d89095b4fb2f3b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511204420872606e54d28a9d89095b4fb2f3b 2023-11-28 14:53:48,761 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/538474cfc8ba47608507a27ad5d8b246 2023-11-28 14:53:48,767 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/538474cfc8ba47608507a27ad5d8b246 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/538474cfc8ba47608507a27ad5d8b246 2023-11-28 14:53:48,772 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/538474cfc8ba47608507a27ad5d8b246, entries=1, sequenceid=41, filesize=4.9 K 2023-11-28 14:53:48,774 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9bb0b6cc0ca47b17cc23194994ed6155 in 834ms, sequenceid=41, compaction requested=true 2023-11-28 14:53:48,774 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:48,774 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:48,774 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:48,774 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:48,774 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,774 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:53:48,774 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:53:48,776 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,776 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:48,776 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,776 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:48,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:48,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:53:48,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3787cf6e[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:48,778 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:48,778 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,779 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,779 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:48,779 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:53:48,779 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:48,779 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,779 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:48,782 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:53:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:53:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:48,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:48,785 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:53:48,785 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:48,785 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:48,785 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,785 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:48,787 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,787 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,787 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:48,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:48,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:48,787 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:48,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:48,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,789 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:48,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,791 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,791 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,791 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:48,791 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:48,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-28 14:53:48,791 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:48,791 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:48,791 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:48,793 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-28 14:53:48,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:48,793 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,793 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,793 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:48,793 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:48,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:48,893 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:48,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:48,897 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-28 14:53:48,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:53:48,899 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:53:48,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:53:48,900 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183828900 2023-11-28 14:53:48,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:53:48,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-28 14:53:48,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:53:48,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x6670dd90 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:53:48,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43f222e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:53:48,911 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:53:49,746 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103deb5d2f9d9bb46c8b38cbad0ccf875bc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103deb5d2f9d9bb46c8b38cbad0ccf875bc 2023-11-28 14:53:49,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:53:49,760 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:53:49,761 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:53:49,769 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:53:49,770 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:53:49,780 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b6eba53c0bfd4a16bcd4f3dfffecc745 first=Optional[r5] last=Optional[r6] 2023-11-28 14:53:49,781 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b6eba53c0bfd4a16bcd4f3dfffecc745}] 2023-11-28 14:53:49,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b6eba53c0bfd4a16bcd4f3dfffecc745 for inclusion in 9bb0b6cc0ca47b17cc23194994ed6155/family1 2023-11-28 14:53:49,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-28 14:53:49,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:53:49,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:49,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b6eba53c0bfd4a16bcd4f3dfffecc745 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__t9nisa6h2874l5btv6kq2djreti9mv218p57cae7008l2ina3cb94tecjj5cdmup/family1/b6eba53c0bfd4a16bcd4f3dfffecc745 2023-11-28 14:53:49,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__t9nisa6h2874l5btv6kq2djreti9mv218p57cae7008l2ina3cb94tecjj5cdmup/family1/b6eba53c0bfd4a16bcd4f3dfffecc745 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/3a32e6535bc943e689ba2961f40055e5_SeqId_44_ 2023-11-28 14:53:49,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__t9nisa6h2874l5btv6kq2djreti9mv218p57cae7008l2ina3cb94tecjj5cdmup/family1/b6eba53c0bfd4a16bcd4f3dfffecc745 into 9bb0b6cc0ca47b17cc23194994ed6155/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/3a32e6535bc943e689ba2961f40055e5_SeqId_44_ - updating store file list. 2023-11-28 14:53:49,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/3a32e6535bc943e689ba2961f40055e5_SeqId_44_ into 9bb0b6cc0ca47b17cc23194994ed6155/family1 2023-11-28 14:53:49,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__t9nisa6h2874l5btv6kq2djreti9mv218p57cae7008l2ina3cb94tecjj5cdmup/family1/b6eba53c0bfd4a16bcd4f3dfffecc745 into 9bb0b6cc0ca47b17cc23194994ed6155/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/3a32e6535bc943e689ba2961f40055e5_SeqId_44_) 2023-11-28 14:53:49,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__t9nisa6h2874l5btv6kq2djreti9mv218p57cae7008l2ina3cb94tecjj5cdmup/family1/b6eba53c0bfd4a16bcd4f3dfffecc745 2023-11-28 14:53:49,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-28 14:53:49,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-28 14:53:49,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): 9bb0b6cc0ca47b17cc23194994ed6155/family1 is initiating minor compaction 2023-11-28 14:53:49,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@554e3d7f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:53:49,800 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9bb0b6cc0ca47b17cc23194994ed6155/family1 in testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:49,801 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/837cae47abdc440aa0e087a75bac2144, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/08c32f99ef5648f086198b2fe732adf1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/959c79c093ec4c28ab5f6beda785aab9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/b01ae34ddaba42518311092b4d466771, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/26de36f90d644341bf604ed9545a239b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/8fd8dc505ffc4125a909065960363c93, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/9219fdcd9988462b85c30337c8807cb6, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/befb4281711544f88b77e8a35308de77, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/538474cfc8ba47608507a27ad5d8b246, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/3a32e6535bc943e689ba2961f40055e5_SeqId_44_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp, totalSize=49.7 K 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 837cae47abdc440aa0e087a75bac2144, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 08c32f99ef5648f086198b2fe732adf1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 959c79c093ec4c28ab5f6beda785aab9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting b01ae34ddaba42518311092b4d466771, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 26de36f90d644341bf604ed9545a239b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 8fd8dc505ffc4125a909065960363c93, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 9219fdcd9988462b85c30337c8807cb6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting befb4281711544f88b77e8a35308de77, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 538474cfc8ba47608507a27ad5d8b246, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-28 14:53:49,801 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 3a32e6535bc943e689ba2961f40055e5_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-28 14:53:49,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:53:49,803 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:49,805 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601013d2932c13b9f498fa0b3195b6dcd32ba to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601013d2932c13b9f498fa0b3195b6dcd32ba 2023-11-28 14:53:49,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601037dda4ff4c6ee468cb4edb4db79838ae6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601037dda4ff4c6ee468cb4edb4db79838ae6 2023-11-28 14:53:49,807 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-28 14:53:49,807 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-28 14:53:49,807 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:53:49,807 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:53:49,851 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9bb0b6cc0ca47b17cc23194994ed6155#family1#compaction#22 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:53:50,672 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123172f70eb95c5e4d12b62f4d7f44b5a8f7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123172f70eb95c5e4d12b62f4d7f44b5a8f7 2023-11-28 14:53:50,673 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/dae3f2d6ba4041ac956929b10c2e51b3 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/dae3f2d6ba4041ac956929b10c2e51b3 2023-11-28 14:53:50,673 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:53:50,680 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 9bb0b6cc0ca47b17cc23194994ed6155/family1 of 9bb0b6cc0ca47b17cc23194994ed6155 into dae3f2d6ba4041ac956929b10c2e51b3(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:53:50,680 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:50,681 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1701183229800; duration=0sec 2023-11-28 14:53:50,681 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:53:50,700 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e8100ff157bf4475855268bf8f4a4c8d first=Optional[r1] last=Optional[r4] 2023-11-28 14:53:50,700 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e8100ff157bf4475855268bf8f4a4c8d}] 2023-11-28 14:53:50,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e8100ff157bf4475855268bf8f4a4c8d for inclusion in 9bb0b6cc0ca47b17cc23194994ed6155/family1 2023-11-28 14:53:50,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-28 14:53:50,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:53:50,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:50,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e8100ff157bf4475855268bf8f4a4c8d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jt1ldts19hn3qnftlr874cbptk3p8s3r37eamvl9qrvfjqojplq70jqi0nikee8o/family1/e8100ff157bf4475855268bf8f4a4c8d 2023-11-28 14:53:50,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jt1ldts19hn3qnftlr874cbptk3p8s3r37eamvl9qrvfjqojplq70jqi0nikee8o/family1/e8100ff157bf4475855268bf8f4a4c8d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/53adf1a1abe84f0fba895f22611f4fc2_SeqId_47_ 2023-11-28 14:53:50,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/837cae47abdc440aa0e087a75bac2144, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/08c32f99ef5648f086198b2fe732adf1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/959c79c093ec4c28ab5f6beda785aab9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/b01ae34ddaba42518311092b4d466771, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/26de36f90d644341bf604ed9545a239b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/8fd8dc505ffc4125a909065960363c93, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/9219fdcd9988462b85c30337c8807cb6, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/befb4281711544f88b77e8a35308de77, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/538474cfc8ba47608507a27ad5d8b246, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/3a32e6535bc943e689ba2961f40055e5_SeqId_44_] to archive 2023-11-28 14:53:50,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jt1ldts19hn3qnftlr874cbptk3p8s3r37eamvl9qrvfjqojplq70jqi0nikee8o/family1/e8100ff157bf4475855268bf8f4a4c8d into 9bb0b6cc0ca47b17cc23194994ed6155/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/53adf1a1abe84f0fba895f22611f4fc2_SeqId_47_ - updating store file list. 2023-11-28 14:53:50,720 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:50,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/837cae47abdc440aa0e087a75bac2144 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/837cae47abdc440aa0e087a75bac2144 2023-11-28 14:53:50,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/08c32f99ef5648f086198b2fe732adf1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/08c32f99ef5648f086198b2fe732adf1 2023-11-28 14:53:50,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/53adf1a1abe84f0fba895f22611f4fc2_SeqId_47_ into 9bb0b6cc0ca47b17cc23194994ed6155/family1 2023-11-28 14:53:50,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jt1ldts19hn3qnftlr874cbptk3p8s3r37eamvl9qrvfjqojplq70jqi0nikee8o/family1/e8100ff157bf4475855268bf8f4a4c8d into 9bb0b6cc0ca47b17cc23194994ed6155/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/53adf1a1abe84f0fba895f22611f4fc2_SeqId_47_) 2023-11-28 14:53:50,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jt1ldts19hn3qnftlr874cbptk3p8s3r37eamvl9qrvfjqojplq70jqi0nikee8o/family1/e8100ff157bf4475855268bf8f4a4c8d 2023-11-28 14:53:50,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-28 14:53:50,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/959c79c093ec4c28ab5f6beda785aab9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/959c79c093ec4c28ab5f6beda785aab9 2023-11-28 14:53:50,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-28 14:53:50,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): 9bb0b6cc0ca47b17cc23194994ed6155/family1 is initiating minor compaction (all files) 2023-11-28 14:53:50,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@68b35f49; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:53:50,726 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9bb0b6cc0ca47b17cc23194994ed6155/family1 in testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:53:50,726 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/0979e599113a4287bea245461eaa0815, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/dae3f2d6ba4041ac956929b10c2e51b3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/53adf1a1abe84f0fba895f22611f4fc2_SeqId_47_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp, totalSize=178.1 K 2023-11-28 14:53:50,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/b01ae34ddaba42518311092b4d466771 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/b01ae34ddaba42518311092b4d466771 2023-11-28 14:53:50,727 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 0979e599113a4287bea245461eaa0815, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824829 2023-11-28 14:53:50,728 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting dae3f2d6ba4041ac956929b10c2e51b3, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224829 2023-11-28 14:53:50,728 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 53adf1a1abe84f0fba895f22611f4fc2_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224829 2023-11-28 14:53:50,728 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:53:50,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/26de36f90d644341bf604ed9545a239b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/26de36f90d644341bf604ed9545a239b 2023-11-28 14:53:50,729 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:50,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/8fd8dc505ffc4125a909065960363c93 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/8fd8dc505ffc4125a909065960363c93 2023-11-28 14:53:50,732 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201179d6022481547b8a9d9f22a63624f53 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201179d6022481547b8a9d9f22a63624f53 2023-11-28 14:53:50,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/9219fdcd9988462b85c30337c8807cb6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/9219fdcd9988462b85c30337c8807cb6 2023-11-28 14:53:50,733 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120512ab0305fcbc459bb093260ea120ceff to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120512ab0305fcbc459bb093260ea120ceff 2023-11-28 14:53:50,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/befb4281711544f88b77e8a35308de77 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/befb4281711544f88b77e8a35308de77 2023-11-28 14:53:50,735 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122885aab566de4a42f284f40aa81fffe7ab to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122885aab566de4a42f284f40aa81fffe7ab 2023-11-28 14:53:50,737 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512316a0e235d139f46709f0cdbf148286a29 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512316a0e235d139f46709f0cdbf148286a29 2023-11-28 14:53:50,737 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-28 14:53:50,737 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-28 14:53:50,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/538474cfc8ba47608507a27ad5d8b246 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/538474cfc8ba47608507a27ad5d8b246 2023-11-28 14:53:50,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:53:50,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:53:50,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/3a32e6535bc943e689ba2961f40055e5_SeqId_44_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/3a32e6535bc943e689ba2961f40055e5_SeqId_44_ 2023-11-28 14:53:50,764 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9bb0b6cc0ca47b17cc23194994ed6155#family1#compaction#23 average throughput is 11.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:53:51,598 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305e661218144f4014968a96e00c13433e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511305e661218144f4014968a96e00c13433e 2023-11-28 14:53:51,599 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:53:51,625 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bc265c2d68c343a7bb59ee17183c9a0b first=Optional[r00] last=Optional[r8] 2023-11-28 14:53:51,626 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bc265c2d68c343a7bb59ee17183c9a0b}] 2023-11-28 14:53:51,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bc265c2d68c343a7bb59ee17183c9a0b for inclusion in 9bb0b6cc0ca47b17cc23194994ed6155/family1 2023-11-28 14:53:51,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-28 14:53:51,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:53:51,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:51,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bc265c2d68c343a7bb59ee17183c9a0b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e3jq851562nkn8frjg2cuuqis4ncou604elblvpjd4424ckpddbd1b9o1ncill0/family1/bc265c2d68c343a7bb59ee17183c9a0b 2023-11-28 14:53:51,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e3jq851562nkn8frjg2cuuqis4ncou604elblvpjd4424ckpddbd1b9o1ncill0/family1/bc265c2d68c343a7bb59ee17183c9a0b as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/4c0fa55e36534d56a85722d8fcbe16cd_SeqId_49_ 2023-11-28 14:53:51,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e3jq851562nkn8frjg2cuuqis4ncou604elblvpjd4424ckpddbd1b9o1ncill0/family1/bc265c2d68c343a7bb59ee17183c9a0b into 9bb0b6cc0ca47b17cc23194994ed6155/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/4c0fa55e36534d56a85722d8fcbe16cd_SeqId_49_ - updating store file list. 2023-11-28 14:53:51,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/4c0fa55e36534d56a85722d8fcbe16cd_SeqId_49_ into 9bb0b6cc0ca47b17cc23194994ed6155/family1 2023-11-28 14:53:51,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e3jq851562nkn8frjg2cuuqis4ncou604elblvpjd4424ckpddbd1b9o1ncill0/family1/bc265c2d68c343a7bb59ee17183c9a0b into 9bb0b6cc0ca47b17cc23194994ed6155/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/4c0fa55e36534d56a85722d8fcbe16cd_SeqId_49_) 2023-11-28 14:53:51,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithMonthlyPolicy__e3jq851562nkn8frjg2cuuqis4ncou604elblvpjd4424ckpddbd1b9o1ncill0/family1/bc265c2d68c343a7bb59ee17183c9a0b 2023-11-28 14:53:51,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:53:51,644 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:51,646 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511204420872606e54d28a9d89095b4fb2f3b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511204420872606e54d28a9d89095b4fb2f3b 2023-11-28 14:53:51,647 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112805fa9466833c4f059e5fa1fb8f28e7e5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112805fa9466833c4f059e5fa1fb8f28e7e5 2023-11-28 14:53:51,648 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511305efda4c12f75442f83d9c9806212199c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511305efda4c12f75442f83d9c9806212199c 2023-11-28 14:53:51,648 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-28 14:53:51,649 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-28 14:53:51,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:53:51,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:53:51,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:53:51,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:53:51,649 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:53:51,650 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:53:51,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.7530 sec 2023-11-28 14:53:51,753 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=253 (was 244) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/c1d7b51166a24b649fe3dab78cd3bb9a java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x69230551-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44530 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44390 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69230551-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44320 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69230551-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44484 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44470 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69230551-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44516 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44596 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62725@0x6670dd90-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62725@0x6670dd90-SendThread(127.0.0.1:62725) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44404 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62725@0x6670dd90 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/359756548.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2135076928_17 at /127.0.0.1:44286 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69230551-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44414 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44486 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69230551-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69230551-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44500 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44592 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1355881425_17 at /127.0.0.1:44364 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=628 (was 605) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 324), ProcessCount=172 (was 172), AvailableMemoryMB=7774 (was 7782) 2023-11-28 14:53:51,765 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=253, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=172, AvailableMemoryMB=7774 2023-11-28 14:53:51,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-28 14:53:51,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:51,770 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:53:51,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-28 14:53:51,771 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:53:51,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-28 14:53:51,772 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:53:51,773 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6 empty. 2023-11-28 14:53:51,774 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:53:51,774 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-28 14:53:51,784 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-28 14:53:51,785 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => ad7ce42a0018a9c883486c1d65dc4fc6, NAME => 'testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:53:51,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-28 14:53:51,994 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/.tmp/family1/c1d7b51166a24b649fe3dab78cd3bb9a as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/c1d7b51166a24b649fe3dab78cd3bb9a 2023-11-28 14:53:52,000 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9bb0b6cc0ca47b17cc23194994ed6155/family1 of 9bb0b6cc0ca47b17cc23194994ed6155 into c1d7b51166a24b649fe3dab78cd3bb9a(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:53:52,000 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:53:52,001 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1701183230726; duration=1sec 2023-11-28 14:53:52,001 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:53:52,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-28 14:53:52,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/0979e599113a4287bea245461eaa0815, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/dae3f2d6ba4041ac956929b10c2e51b3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/53adf1a1abe84f0fba895f22611f4fc2_SeqId_47_] to archive 2023-11-28 14:53:52,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:53:52,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/0979e599113a4287bea245461eaa0815 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/0979e599113a4287bea245461eaa0815 2023-11-28 14:53:52,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/dae3f2d6ba4041ac956929b10c2e51b3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/dae3f2d6ba4041ac956929b10c2e51b3 2023-11-28 14:53:52,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/53adf1a1abe84f0fba895f22611f4fc2_SeqId_47_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/family1/53adf1a1abe84f0fba895f22611f4fc2_SeqId_47_ 2023-11-28 14:53:52,194 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:52,194 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing ad7ce42a0018a9c883486c1d65dc4fc6, disabling compactions & flushes 2023-11-28 14:53:52,194 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:52,194 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:52,194 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. after waiting 0 ms 2023-11-28 14:53:52,194 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:52,194 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:52,194 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:52,197 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:53:52,198 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701183232198"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183232198"}]},"ts":"1701183232198"} 2023-11-28 14:53:52,200 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-28 14:53:52,201 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:53:52,201 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183232201"}]},"ts":"1701183232201"} 2023-11-28 14:53:52,202 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-28 14:53:52,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=ad7ce42a0018a9c883486c1d65dc4fc6, ASSIGN}] 2023-11-28 14:53:52,207 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=ad7ce42a0018a9c883486c1d65dc4fc6, ASSIGN 2023-11-28 14:53:52,208 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=ad7ce42a0018a9c883486c1d65dc4fc6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:53:52,359 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=ad7ce42a0018a9c883486c1d65dc4fc6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:52,359 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701183232359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183232359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183232359"}]},"ts":"1701183232359"} 2023-11-28 14:53:52,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure ad7ce42a0018a9c883486c1d65dc4fc6, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:53:52,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-28 14:53:52,513 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:52,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:52,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ad7ce42a0018a9c883486c1d65dc4fc6, NAME => 'testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:53:52,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:53:52,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:53:52,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:53:52,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:53:52,519 INFO [StoreOpener-ad7ce42a0018a9c883486c1d65dc4fc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:53:52,520 DEBUG [StoreOpener-ad7ce42a0018a9c883486c1d65dc4fc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1 2023-11-28 14:53:52,520 DEBUG [StoreOpener-ad7ce42a0018a9c883486c1d65dc4fc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1 2023-11-28 14:53:52,521 INFO [StoreOpener-ad7ce42a0018a9c883486c1d65dc4fc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad7ce42a0018a9c883486c1d65dc4fc6 columnFamilyName family1 2023-11-28 14:53:52,522 INFO [StoreOpener-ad7ce42a0018a9c883486c1d65dc4fc6-1] regionserver.HStore(310): Store=ad7ce42a0018a9c883486c1d65dc4fc6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:53:52,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:53:52,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:53:52,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:53:52,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:53:52,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ad7ce42a0018a9c883486c1d65dc4fc6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75442936, jitterRate=0.12418735027313232}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:53:52,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:52,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6., pid=25, masterSystemTime=1701183232513 2023-11-28 14:53:52,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:52,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:52,531 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=ad7ce42a0018a9c883486c1d65dc4fc6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:52,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701183232531"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183232531"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183232531"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183232531"}]},"ts":"1701183232531"} 2023-11-28 14:53:52,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=25, resume processing ppid=24 2023-11-28 14:53:52,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure ad7ce42a0018a9c883486c1d65dc4fc6, server=jenkins-hbase4.apache.org,41403,1701183201531 in 172 msec 2023-11-28 14:53:52,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=24, resume processing ppid=23 2023-11-28 14:53:52,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=ad7ce42a0018a9c883486c1d65dc4fc6, ASSIGN in 330 msec 2023-11-28 14:53:52,538 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:53:52,538 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183232538"}]},"ts":"1701183232538"} 2023-11-28 14:53:52,539 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-28 14:53:52,542 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:53:52,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 775 msec 2023-11-28 14:53:52,678 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:52,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-28 14:53:52,876 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-28 14:53:52,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:52,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:52,902 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:52,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:52,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:52,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:52,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:52,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:52,905 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:52,905 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:52,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:52,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:52,905 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:52,905 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:52,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:52,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:52,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:52,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:52,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:52,906 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:52,906 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:52,906 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:52,908 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:52,908 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:52,908 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:52,908 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:52,909 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-28 14:53:53,336 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309923686685ed46bbb3aaad695cc9a0c4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511309923686685ed46bbb3aaad695cc9a0c4 2023-11-28 14:53:53,741 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/c40cdf6f9fce4b64b0d590977d2d3834 2023-11-28 14:53:53,747 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/c40cdf6f9fce4b64b0d590977d2d3834 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/c40cdf6f9fce4b64b0d590977d2d3834 2023-11-28 14:53:53,751 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/c40cdf6f9fce4b64b0d590977d2d3834, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-28 14:53:53,753 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 844ms, sequenceid=5, compaction requested=false 2023-11-28 14:53:53,753 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:53,753 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:53,753 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:53:53,754 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:53:53,755 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,755 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:53,756 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,756 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:53,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:53,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:53:53,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4031714b[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:53,758 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:53,758 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,759 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,759 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:53,759 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:53:53,759 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:53,759 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,759 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:53,761 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,761 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:53:53,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:53,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:53,761 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:53,761 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:53:53,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:53,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:53,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:53,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:53,763 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:53:53,764 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:53,764 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:53,764 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,764 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:53,766 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,766 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,766 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:53,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:53,767 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:53,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,768 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:53,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,770 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,770 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,770 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:53,770 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,771 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:53,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:53:53,771 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:53,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:53,771 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:53,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:53,771 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:53,771 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,771 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:53,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:53,771 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:53,771 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:53,871 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:53,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:53,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:53,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:53,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,879 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:53,879 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:53,879 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:53,879 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:53,880 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,880 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,881 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:53,882 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:53,882 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:53,882 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:53,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,883 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,883 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:53:53,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:53,883 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:53,883 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:53,883 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:53,883 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:53,884 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:53,884 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:53,884 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:53,884 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-28 14:53:54,299 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112836efd6e9928f4e49a362c859b3dc7daf to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112836efd6e9928f4e49a362c859b3dc7daf 2023-11-28 14:53:54,705 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/188f85ca949f4604aadc8db9e5218ebd 2023-11-28 14:53:54,711 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/188f85ca949f4604aadc8db9e5218ebd as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/188f85ca949f4604aadc8db9e5218ebd 2023-11-28 14:53:54,716 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/188f85ca949f4604aadc8db9e5218ebd, entries=1, sequenceid=9, filesize=5.0 K 2023-11-28 14:53:54,717 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 833ms, sequenceid=9, compaction requested=false 2023-11-28 14:53:54,717 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:54,717 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:54,717 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:54,718 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:54,718 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,718 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:53:54,718 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:53:54,724 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:54,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:54,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:53:54,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47cb9ba0[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:54,726 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:54,726 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,727 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,727 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:54,727 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:53:54,727 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:54,727 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,727 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:54,729 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:53:54,729 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,729 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:54,729 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:53:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:54,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:54,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:54,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:54,731 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:53:54,731 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:54,731 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:54,731 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,731 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:54,733 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,733 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,733 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:54,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:54,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:54,734 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,735 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:54,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,739 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,739 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:54,739 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:54,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:54,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:54,739 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,739 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:54,739 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,739 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:54,740 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,740 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,740 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,740 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:54,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:54,740 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:54,840 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:54,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:54,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:54,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:54,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,848 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:54,848 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:54,848 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:54,848 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:54,848 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,849 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,850 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:54,850 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:54,850 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:54,850 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,851 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,851 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:53:54,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:54,851 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:54,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:54,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:54,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:54,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:54,852 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:54,852 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:54,852 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:55,268 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010f0f63a58f3343d08a9fba8a525cc57a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512010f0f63a58f3343d08a9fba8a525cc57a 2023-11-28 14:53:55,274 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/32772d36480b4f59bf88638130634445 2023-11-28 14:53:55,279 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/32772d36480b4f59bf88638130634445 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/32772d36480b4f59bf88638130634445 2023-11-28 14:53:55,283 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/32772d36480b4f59bf88638130634445, entries=1, sequenceid=13, filesize=4.9 K 2023-11-28 14:53:55,284 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 432ms, sequenceid=13, compaction requested=true 2023-11-28 14:53:55,284 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:55,284 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:55,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:55,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:55,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:53:55,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:53:55,286 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:55,286 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:55,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:55,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:53:55,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48d712e7[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:55,288 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:55,288 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,289 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,290 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:55,290 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:53:55,290 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:55,290 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,290 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:55,292 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:53:55,292 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,292 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:55,292 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:53:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:55,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:55,295 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:53:55,295 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:55,295 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:55,295 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,295 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:55,296 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,296 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:55,296 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,297 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,298 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:55,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:55,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:55,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:55,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:55,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:53:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:55,301 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:55,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,301 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:55,302 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:55,302 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,302 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,302 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,402 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:55,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:55,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:55,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:55,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,410 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:55,410 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:55,410 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:55,410 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:55,410 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,410 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,412 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:55,412 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:55,412 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,412 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:55,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,413 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,413 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:53:55,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,413 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:55,413 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:55,413 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:55,414 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:55,414 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:55,414 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:55,414 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:55,414 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:55,427 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205aa05e66e1a3041eb85dbfaebf751e879 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205aa05e66e1a3041eb85dbfaebf751e879 2023-11-28 14:53:55,833 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/7994abc23c744028bd5b7280c0c17829 2023-11-28 14:53:55,838 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/7994abc23c744028bd5b7280c0c17829 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/7994abc23c744028bd5b7280c0c17829 2023-11-28 14:53:55,843 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/7994abc23c744028bd5b7280c0c17829, entries=1, sequenceid=17, filesize=4.9 K 2023-11-28 14:53:55,844 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 430ms, sequenceid=17, compaction requested=true 2023-11-28 14:53:55,844 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:55,844 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:55,845 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:55,845 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:55,845 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,845 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:53:55,845 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:53:55,847 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,847 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:55,848 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:55,848 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:55,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:53:55,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4122582c[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:55,849 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:55,849 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,850 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,850 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:55,850 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:53:55,850 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:55,851 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,851 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:55,852 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:53:55,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:55,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:55,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:55,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:53:55,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:55,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:55,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:55,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:55,855 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:53:55,855 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:55,855 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:55,855 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,855 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:55,856 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,856 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,856 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:55,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:55,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:55,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:55,857 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:55,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:55,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:55,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,858 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:55,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,865 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,865 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,865 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:55,865 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:55,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:53:55,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:55,865 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:55,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:55,865 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:55,865 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:55,865 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:55,866 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:55,866 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,866 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:55,866 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:55,966 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:55,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:55,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:55,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:55,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,973 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:55,973 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:55,973 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:55,973 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:55,974 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,974 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,975 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:55,975 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:55,976 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:55,976 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,977 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,977 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:53:55,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:55,977 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:55,977 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:55,977 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:55,977 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:55,977 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:55,977 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:55,977 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:55,977 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:56,391 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286e0b5353df864162a758fecef4768271 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286e0b5353df864162a758fecef4768271 2023-11-28 14:53:56,798 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/823a076f01fb48e9ac31ed12ba37827c 2023-11-28 14:53:56,803 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/823a076f01fb48e9ac31ed12ba37827c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/823a076f01fb48e9ac31ed12ba37827c 2023-11-28 14:53:56,809 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/823a076f01fb48e9ac31ed12ba37827c, entries=1, sequenceid=21, filesize=4.9 K 2023-11-28 14:53:56,810 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 833ms, sequenceid=21, compaction requested=true 2023-11-28 14:53:56,810 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:56,810 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:56,810 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:56,810 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:56,810 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,810 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:53:56,810 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:53:56,812 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,812 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:56,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:56,813 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,813 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:56,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:56,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:56,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:56,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:53:56,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a52c26a[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:56,815 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:56,815 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,816 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,816 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:56,816 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:53:56,816 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:56,816 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,816 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:56,819 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,819 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:53:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:56,819 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:56,819 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:53:56,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:56,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:56,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:56,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:56,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:56,822 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:53:56,822 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:56,822 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:56,822 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,822 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:56,824 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,824 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:56,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:56,824 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:56,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:56,824 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:56,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:56,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,826 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:56,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,828 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,828 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:56,828 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,828 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,828 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:56,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:56,828 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:56,829 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:56,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:56,828 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:56,829 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:56,829 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:56,829 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:56,829 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:56,929 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:56,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:56,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:56,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:56,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,936 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:56,936 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:56,936 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:56,936 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:56,937 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,937 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,939 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:56,939 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:56,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:56,939 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,939 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:56,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:56,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:53:56,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,940 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:56,940 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:56,940 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:56,941 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:56,941 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:56,941 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:56,955 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fd482b431243410a8fe12d18cdae5aff to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231fd482b431243410a8fe12d18cdae5aff 2023-11-28 14:53:56,960 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/af8cc62410c04082a7d0d1f77c38a262 2023-11-28 14:53:56,966 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/af8cc62410c04082a7d0d1f77c38a262 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/af8cc62410c04082a7d0d1f77c38a262 2023-11-28 14:53:56,971 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/af8cc62410c04082a7d0d1f77c38a262, entries=1, sequenceid=25, filesize=4.9 K 2023-11-28 14:53:56,972 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 31ms, sequenceid=25, compaction requested=true 2023-11-28 14:53:56,972 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:56,972 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:56,972 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:56,972 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:56,972 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,972 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:53:56,972 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:53:56,975 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,975 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:56,975 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,975 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:56,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:56,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:53:56,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11df5e1b[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:56,977 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:56,977 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,979 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,979 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:56,979 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:53:56,979 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:56,979 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,979 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:56,980 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,980 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:53:56,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:56,980 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:56,981 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:53:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:56,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:56,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:56,983 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:53:56,983 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:56,983 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:56,983 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,983 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:56,985 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,985 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:56,985 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,985 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:56,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:56,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:56,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:56,987 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,990 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,990 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,990 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,990 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:56,990 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:56,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:56,991 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:56,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:56,990 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:56,990 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:56,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:56,991 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:53:56,991 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:56,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:56,991 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:56,991 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:57,092 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:57,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:57,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:57,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:57,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,100 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:57,100 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:57,100 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:57,100 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:57,100 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,101 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,102 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:57,102 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:57,102 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,102 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,103 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,103 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:53:57,103 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,104 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:57,104 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:57,104 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:57,104 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:57,104 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:57,104 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:57,104 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:57,104 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:57,518 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c35572c4424e41d4a026785d3610368b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101c35572c4424e41d4a026785d3610368b 2023-11-28 14:53:57,525 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/97e5b2d8bb5a48a39c29857294e01807 2023-11-28 14:53:57,533 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/97e5b2d8bb5a48a39c29857294e01807 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97e5b2d8bb5a48a39c29857294e01807 2023-11-28 14:53:57,539 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97e5b2d8bb5a48a39c29857294e01807, entries=1, sequenceid=29, filesize=4.9 K 2023-11-28 14:53:57,540 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 436ms, sequenceid=29, compaction requested=true 2023-11-28 14:53:57,540 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:57,540 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:57,540 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:57,540 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:57,540 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,540 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:53:57,540 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:53:57,543 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,543 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:57,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:57,543 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,543 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:57,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:57,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:57,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:57,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:53:57,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@616f36ed[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:57,545 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:57,545 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,547 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,547 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:57,547 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:53:57,547 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:57,547 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,547 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:57,548 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,548 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:53:57,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:57,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:57,548 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:57,549 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:53:57,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:57,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:57,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:57,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:57,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:57,551 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:53:57,551 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:57,551 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:57,551 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,551 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:57,557 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,557 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:57,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:57,557 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:57,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:57,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:57,557 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:57,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:57,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,559 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:57,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,561 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,561 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:57,561 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:57,562 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:57,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:57,561 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:57,562 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,562 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:57,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:57,562 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,562 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,562 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:57,562 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:57,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:57,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:57,562 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,662 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:57,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:57,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:57,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:57,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,669 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:57,670 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:57,670 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:57,670 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:57,670 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,670 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,672 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:57,672 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:57,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:57,672 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:57,672 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:57,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:57,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,673 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,673 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:53:57,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:57,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:57,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:57,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:57,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:57,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:57,673 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:57,673 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:57,673 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:58,047 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:53:58,087 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e5ce63c0e3704dffa1e3b2c687e2efda to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e5ce63c0e3704dffa1e3b2c687e2efda 2023-11-28 14:53:58,493 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/97cc7c3560ed43a084d2e0f9da7f269b 2023-11-28 14:53:58,499 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/97cc7c3560ed43a084d2e0f9da7f269b as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97cc7c3560ed43a084d2e0f9da7f269b 2023-11-28 14:53:58,504 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97cc7c3560ed43a084d2e0f9da7f269b, entries=1, sequenceid=33, filesize=4.9 K 2023-11-28 14:53:58,505 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 832ms, sequenceid=33, compaction requested=true 2023-11-28 14:53:58,505 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:58,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:58,506 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:58,506 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:58,506 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,506 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:53:58,506 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:53:58,508 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,508 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:58,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:58,508 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,508 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:58,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:58,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:58,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:58,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:53:58,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32dff1d4[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:58,510 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:58,510 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,512 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:58,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:53:58,513 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:58,513 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,513 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:58,514 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,514 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:53:58,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:58,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:58,514 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:58,514 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:53:58,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:58,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:58,516 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:53:58,516 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:58,516 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:58,516 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,517 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:58,518 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,518 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:58,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,518 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:58,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:58,519 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:58,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,520 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:58,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,523 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,523 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:58,523 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:58,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:58,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:58,524 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,524 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,524 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,524 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,524 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:58,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:58,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:58,524 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,524 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,525 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:58,525 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:58,625 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:58,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:58,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:58,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:58,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,632 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:58,632 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:58,632 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:58,632 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:58,632 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,632 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,638 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,638 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:58,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:58,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:58,639 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:58,639 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:58,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:58,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,639 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,640 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:53:58,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:58,640 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:58,640 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:58,640 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:58,640 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:58,640 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:58,640 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:58,640 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:58,640 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:53:59,054 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ec7cc93f8d544249bdb3e8ae9b77b2a1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907ec7cc93f8d544249bdb3e8ae9b77b2a1 2023-11-28 14:53:59,460 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/3f4ff9cb21254e18b99fb5f081fc922e 2023-11-28 14:53:59,465 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/3f4ff9cb21254e18b99fb5f081fc922e as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/3f4ff9cb21254e18b99fb5f081fc922e 2023-11-28 14:53:59,469 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/3f4ff9cb21254e18b99fb5f081fc922e, entries=1, sequenceid=37, filesize=4.9 K 2023-11-28 14:53:59,470 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 830ms, sequenceid=37, compaction requested=true 2023-11-28 14:53:59,470 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:53:59,470 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:59,470 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:53:59,470 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:53:59,471 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,471 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:53:59,471 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:53:59,472 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,473 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:59,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:59,473 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,473 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:53:59,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:59,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:59,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:53:59,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e823477[Count = 0] remaining members to acquire global barrier 2023-11-28 14:53:59,475 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:53:59,475 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,476 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:53:59,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:53:59,476 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,476 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:53:59,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:53:59,478 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,478 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:53:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:59,478 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:59,478 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:53:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:53:59,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:53:59,480 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:53:59,480 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:53:59,480 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:53:59,480 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,480 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:53:59,483 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,483 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:53:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:53:59,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,483 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:53:59,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:59,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:59,484 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:53:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,485 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:53:59,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,487 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,487 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,487 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:59,487 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:59,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:53:59,487 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:59,487 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:53:59,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:53:59,487 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:53:59,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:59,488 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,488 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:53:59,488 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,488 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:53:59,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:53:59,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:53:59,488 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,588 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:53:59,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:53:59,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:53:59,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:53:59,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,596 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:53:59,596 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:59,596 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:53:59,596 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:53:59,596 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,596 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,598 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,598 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:53:59,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:53:59,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:53:59,598 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:53:59,598 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:53:59,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:53:59,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,599 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,599 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:53:59,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:53:59,599 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:53:59,599 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. started... 2023-11-28 14:53:59,599 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ad7ce42a0018a9c883486c1d65dc4fc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:00,013 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200770dd75ad3046bdb04ac7d4f149895d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511200770dd75ad3046bdb04ac7d4f149895d 2023-11-28 14:54:00,420 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/f7e3f7876f33465db6fb10d5571eaadf 2023-11-28 14:54:00,426 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/f7e3f7876f33465db6fb10d5571eaadf as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/f7e3f7876f33465db6fb10d5571eaadf 2023-11-28 14:54:00,431 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/f7e3f7876f33465db6fb10d5571eaadf, entries=1, sequenceid=41, filesize=4.9 K 2023-11-28 14:54:00,432 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ad7ce42a0018a9c883486c1d65dc4fc6 in 833ms, sequenceid=41, compaction requested=true 2023-11-28 14:54:00,432 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:54:00,432 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:54:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:00,432 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,433 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:00,433 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:00,438 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:00,439 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:00,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:00,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4546883a[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:00,441 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:00,441 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,442 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:00,442 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,443 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:00,444 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,444 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:00,444 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:00,444 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:00,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:00,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:00,447 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:00,447 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:00,447 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:00,447 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,447 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:00,448 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,449 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:00,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,449 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:00,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:00,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:00,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:00,449 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:00,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,451 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:00,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,455 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,455 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,455 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:00,455 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:00,455 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:00,455 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:00,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:54:00,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-28 14:54:00,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:00,455 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:00,455 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,455 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,455 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,456 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:00,456 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:00,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:00,556 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:00,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:00,558 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-28 14:54:00,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:54:00,561 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:54:00,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:00,562 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183840562 2023-11-28 14:54:00,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-28 14:54:00,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-28 14:54:00,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:00,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x249a163a to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:00,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76adfd46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:00,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,012 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038bbc54a417854df39e91f66b6ab682c7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038bbc54a417854df39e91f66b6ab682c7 2023-11-28 14:54:01,013 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:01,027 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:54:01,028 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:54:01,035 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:54:01,036 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:54:01,046 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bdf133bc9c2c4bd8a770419f43faf91b first=Optional[r3] last=Optional[r6] 2023-11-28 14:54:01,047 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bdf133bc9c2c4bd8a770419f43faf91b}] 2023-11-28 14:54:01,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bdf133bc9c2c4bd8a770419f43faf91b for inclusion in ad7ce42a0018a9c883486c1d65dc4fc6/family1 2023-11-28 14:54:01,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-28 14:54:01,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:01,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:54:01,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bdf133bc9c2c4bd8a770419f43faf91b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ucujgcur0knjc10k551lk410k1d5837g7fnvauvkn2cesi33err52isugffcfjp7/family1/bdf133bc9c2c4bd8a770419f43faf91b 2023-11-28 14:54:01,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ucujgcur0knjc10k551lk410k1d5837g7fnvauvkn2cesi33err52isugffcfjp7/family1/bdf133bc9c2c4bd8a770419f43faf91b as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/226dda9909e4425aa4847fbe12a2e504_SeqId_44_ 2023-11-28 14:54:01,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ucujgcur0knjc10k551lk410k1d5837g7fnvauvkn2cesi33err52isugffcfjp7/family1/bdf133bc9c2c4bd8a770419f43faf91b into ad7ce42a0018a9c883486c1d65dc4fc6/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/226dda9909e4425aa4847fbe12a2e504_SeqId_44_ - updating store file list. 2023-11-28 14:54:01,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/226dda9909e4425aa4847fbe12a2e504_SeqId_44_ into ad7ce42a0018a9c883486c1d65dc4fc6/family1 2023-11-28 14:54:01,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ucujgcur0knjc10k551lk410k1d5837g7fnvauvkn2cesi33err52isugffcfjp7/family1/bdf133bc9c2c4bd8a770419f43faf91b into ad7ce42a0018a9c883486c1d65dc4fc6/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/226dda9909e4425aa4847fbe12a2e504_SeqId_44_) 2023-11-28 14:54:01,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ucujgcur0knjc10k551lk410k1d5837g7fnvauvkn2cesi33err52isugffcfjp7/family1/bdf133bc9c2c4bd8a770419f43faf91b 2023-11-28 14:54:01,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-28 14:54:01,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-28 14:54:01,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): ad7ce42a0018a9c883486c1d65dc4fc6/family1 is initiating minor compaction 2023-11-28 14:54:01,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@624f5c96; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:01,070 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ad7ce42a0018a9c883486c1d65dc4fc6/family1 in testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:54:01,070 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/188f85ca949f4604aadc8db9e5218ebd, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/32772d36480b4f59bf88638130634445, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/7994abc23c744028bd5b7280c0c17829, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/823a076f01fb48e9ac31ed12ba37827c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/af8cc62410c04082a7d0d1f77c38a262, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97e5b2d8bb5a48a39c29857294e01807, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97cc7c3560ed43a084d2e0f9da7f269b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/3f4ff9cb21254e18b99fb5f081fc922e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/f7e3f7876f33465db6fb10d5571eaadf, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/226dda9909e4425aa4847fbe12a2e504_SeqId_44_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp, totalSize=50.0 K 2023-11-28 14:54:01,070 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 188f85ca949f4604aadc8db9e5218ebd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-28 14:54:01,070 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 32772d36480b4f59bf88638130634445, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-28 14:54:01,070 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 7994abc23c744028bd5b7280c0c17829, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-28 14:54:01,070 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 823a076f01fb48e9ac31ed12ba37827c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-28 14:54:01,070 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting af8cc62410c04082a7d0d1f77c38a262, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-28 14:54:01,070 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 97e5b2d8bb5a48a39c29857294e01807, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-28 14:54:01,071 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 97cc7c3560ed43a084d2e0f9da7f269b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-28 14:54:01,071 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 3f4ff9cb21254e18b99fb5f081fc922e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-28 14:54:01,071 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting f7e3f7876f33465db6fb10d5571eaadf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-28 14:54:01,071 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 226dda9909e4425aa4847fbe12a2e504_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-28 14:54:01,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:01,073 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:01,075 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286e0b5353df864162a758fecef4768271 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286e0b5353df864162a758fecef4768271 2023-11-28 14:54:01,076 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231fd482b431243410a8fe12d18cdae5aff to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231fd482b431243410a8fe12d18cdae5aff 2023-11-28 14:54:01,078 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101c35572c4424e41d4a026785d3610368b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101c35572c4424e41d4a026785d3610368b 2023-11-28 14:54:01,080 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e5ce63c0e3704dffa1e3b2c687e2efda to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e5ce63c0e3704dffa1e3b2c687e2efda 2023-11-28 14:54:01,080 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-28 14:54:01,080 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-28 14:54:01,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,117 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): ad7ce42a0018a9c883486c1d65dc4fc6#family1#compaction#34 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:54:01,536 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120542a76a73b2cc473bbcefd380048ef487 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120542a76a73b2cc473bbcefd380048ef487 2023-11-28 14:54:01,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:01,564 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7b8f09966a4a461380a6c56dd210d7ac first=Optional[r1] last=Optional[r2] 2023-11-28 14:54:01,564 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7b8f09966a4a461380a6c56dd210d7ac}] 2023-11-28 14:54:01,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7b8f09966a4a461380a6c56dd210d7ac for inclusion in ad7ce42a0018a9c883486c1d65dc4fc6/family1 2023-11-28 14:54:01,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-28 14:54:01,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:01,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:54:01,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7b8f09966a4a461380a6c56dd210d7ac to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__gi51r2uscsst6isnbqest0tqtiajk64boelq24q070leab7vgrrtq0h7a8kpsmql/family1/7b8f09966a4a461380a6c56dd210d7ac 2023-11-28 14:54:01,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__gi51r2uscsst6isnbqest0tqtiajk64boelq24q070leab7vgrrtq0h7a8kpsmql/family1/7b8f09966a4a461380a6c56dd210d7ac as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/495c2f271b914625a80c3f657f279987_SeqId_46_ 2023-11-28 14:54:01,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__gi51r2uscsst6isnbqest0tqtiajk64boelq24q070leab7vgrrtq0h7a8kpsmql/family1/7b8f09966a4a461380a6c56dd210d7ac into ad7ce42a0018a9c883486c1d65dc4fc6/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/495c2f271b914625a80c3f657f279987_SeqId_46_ - updating store file list. 2023-11-28 14:54:01,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/495c2f271b914625a80c3f657f279987_SeqId_46_ into ad7ce42a0018a9c883486c1d65dc4fc6/family1 2023-11-28 14:54:01,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__gi51r2uscsst6isnbqest0tqtiajk64boelq24q070leab7vgrrtq0h7a8kpsmql/family1/7b8f09966a4a461380a6c56dd210d7ac into ad7ce42a0018a9c883486c1d65dc4fc6/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/495c2f271b914625a80c3f657f279987_SeqId_46_) 2023-11-28 14:54:01,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithWeeklyPolicy__gi51r2uscsst6isnbqest0tqtiajk64boelq24q070leab7vgrrtq0h7a8kpsmql/family1/7b8f09966a4a461380a6c56dd210d7ac 2023-11-28 14:54:01,582 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:01,583 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:01,584 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512010f0f63a58f3343d08a9fba8a525cc57a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512010f0f63a58f3343d08a9fba8a525cc57a 2023-11-28 14:54:01,586 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205aa05e66e1a3041eb85dbfaebf751e879 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205aa05e66e1a3041eb85dbfaebf751e879 2023-11-28 14:54:01,586 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-28 14:54:01,586 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-28 14:54:01,586 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:01,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:01,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:01,587 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:54:01,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0280 sec 2023-11-28 14:54:01,708 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=256 (was 253) - Thread LEAK? -, OpenFileDescriptor=644 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 281), ProcessCount=172 (was 172), AvailableMemoryMB=7749 (was 7774) 2023-11-28 14:54:01,721 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=256, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=172, AvailableMemoryMB=7748 2023-11-28 14:54:01,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-28 14:54:01,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:01,727 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:54:01,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-28 14:54:01,728 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:54:01,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-28 14:54:01,731 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:01,731 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:01,731 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89 2023-11-28 14:54:01,731 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700 empty. 2023-11-28 14:54:01,731 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89 empty. 2023-11-28 14:54:01,731 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b empty. 2023-11-28 14:54:01,732 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:01,732 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:01,732 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89 2023-11-28 14:54:01,732 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-28 14:54:01,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-28 14:54:01,941 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/.tmp/family1/b279b4d0d964486e988105e9e4a6dbfb as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/b279b4d0d964486e988105e9e4a6dbfb 2023-11-28 14:54:01,947 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ad7ce42a0018a9c883486c1d65dc4fc6/family1 of ad7ce42a0018a9c883486c1d65dc4fc6 into b279b4d0d964486e988105e9e4a6dbfb(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:54:01,947 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:54:01,947 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1701183241070; duration=0sec 2023-11-28 14:54:01,948 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:02,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/188f85ca949f4604aadc8db9e5218ebd, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/32772d36480b4f59bf88638130634445, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/7994abc23c744028bd5b7280c0c17829, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/823a076f01fb48e9ac31ed12ba37827c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/af8cc62410c04082a7d0d1f77c38a262, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97e5b2d8bb5a48a39c29857294e01807, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97cc7c3560ed43a084d2e0f9da7f269b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/3f4ff9cb21254e18b99fb5f081fc922e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/f7e3f7876f33465db6fb10d5571eaadf, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/226dda9909e4425aa4847fbe12a2e504_SeqId_44_] to archive 2023-11-28 14:54:02,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:02,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/188f85ca949f4604aadc8db9e5218ebd to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/188f85ca949f4604aadc8db9e5218ebd 2023-11-28 14:54:02,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/32772d36480b4f59bf88638130634445 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/32772d36480b4f59bf88638130634445 2023-11-28 14:54:02,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/7994abc23c744028bd5b7280c0c17829 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/7994abc23c744028bd5b7280c0c17829 2023-11-28 14:54:02,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/823a076f01fb48e9ac31ed12ba37827c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/823a076f01fb48e9ac31ed12ba37827c 2023-11-28 14:54:02,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/af8cc62410c04082a7d0d1f77c38a262 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/af8cc62410c04082a7d0d1f77c38a262 2023-11-28 14:54:02,028 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97e5b2d8bb5a48a39c29857294e01807 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97e5b2d8bb5a48a39c29857294e01807 2023-11-28 14:54:02,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97cc7c3560ed43a084d2e0f9da7f269b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/97cc7c3560ed43a084d2e0f9da7f269b 2023-11-28 14:54:02,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-28 14:54:02,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/3f4ff9cb21254e18b99fb5f081fc922e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/3f4ff9cb21254e18b99fb5f081fc922e 2023-11-28 14:54:02,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/f7e3f7876f33465db6fb10d5571eaadf to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/f7e3f7876f33465db6fb10d5571eaadf 2023-11-28 14:54:02,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/226dda9909e4425aa4847fbe12a2e504_SeqId_44_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/family1/226dda9909e4425aa4847fbe12a2e504_SeqId_44_ 2023-11-28 14:54:02,141 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-28 14:54:02,143 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8c0faa1ee29720150b9862889d03d38b, NAME => 'testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:02,143 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 57c598eec81de40a9c00524003304d89, NAME => 'testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:02,143 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => abb9d45cdbc2ef61c7505454675c3700, NAME => 'testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:02,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 8c0faa1ee29720150b9862889d03d38b, disabling compactions & flushes 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing abb9d45cdbc2ef61c7505454675c3700, disabling compactions & flushes 2023-11-28 14:54:02,557 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:02,557 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. after waiting 0 ms 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. after waiting 0 ms 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:02,557 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 57c598eec81de40a9c00524003304d89, disabling compactions & flushes 2023-11-28 14:54:02,557 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for abb9d45cdbc2ef61c7505454675c3700: 2023-11-28 14:54:02,557 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:02,557 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:02,558 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 8c0faa1ee29720150b9862889d03d38b: 2023-11-28 14:54:02,558 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:02,558 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. after waiting 0 ms 2023-11-28 14:54:02,558 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:02,558 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:02,558 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 57c598eec81de40a9c00524003304d89: 2023-11-28 14:54:02,560 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:54:02,561 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701183242561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183242561"}]},"ts":"1701183242561"} 2023-11-28 14:54:02,561 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701183242561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183242561"}]},"ts":"1701183242561"} 2023-11-28 14:54:02,561 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701183242561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183242561"}]},"ts":"1701183242561"} 2023-11-28 14:54:02,564 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-28 14:54:02,565 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:54:02,565 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183242565"}]},"ts":"1701183242565"} 2023-11-28 14:54:02,567 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-28 14:54:02,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=abb9d45cdbc2ef61c7505454675c3700, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8c0faa1ee29720150b9862889d03d38b, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=57c598eec81de40a9c00524003304d89, ASSIGN}] 2023-11-28 14:54:02,572 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8c0faa1ee29720150b9862889d03d38b, ASSIGN 2023-11-28 14:54:02,572 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=57c598eec81de40a9c00524003304d89, ASSIGN 2023-11-28 14:54:02,572 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=abb9d45cdbc2ef61c7505454675c3700, ASSIGN 2023-11-28 14:54:02,573 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=abb9d45cdbc2ef61c7505454675c3700, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:02,573 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8c0faa1ee29720150b9862889d03d38b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:02,573 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=57c598eec81de40a9c00524003304d89, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:02,725 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=57c598eec81de40a9c00524003304d89, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:02,725 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=abb9d45cdbc2ef61c7505454675c3700, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:02,725 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8c0faa1ee29720150b9862889d03d38b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:02,725 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701183242724"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183242724"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183242724"}]},"ts":"1701183242724"} 2023-11-28 14:54:02,725 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701183242724"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183242724"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183242724"}]},"ts":"1701183242724"} 2023-11-28 14:54:02,725 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701183242725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183242725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183242725"}]},"ts":"1701183242725"} 2023-11-28 14:54:02,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 57c598eec81de40a9c00524003304d89, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:02,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure abb9d45cdbc2ef61c7505454675c3700, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:02,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 8c0faa1ee29720150b9862889d03d38b, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:02,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-28 14:54:02,880 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:02,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:02,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => abb9d45cdbc2ef61c7505454675c3700, NAME => 'testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700.', STARTKEY => '', ENDKEY => '1'} 2023-11-28 14:54:02,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:02,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:02,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:02,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:02,885 INFO [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:02,887 DEBUG [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700/family1 2023-11-28 14:54:02,887 DEBUG [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700/family1 2023-11-28 14:54:02,887 INFO [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abb9d45cdbc2ef61c7505454675c3700 columnFamilyName family1 2023-11-28 14:54:02,889 INFO [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] regionserver.HStore(310): Store=abb9d45cdbc2ef61c7505454675c3700/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:02,889 INFO [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:02,891 DEBUG [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700/family2 2023-11-28 14:54:02,891 DEBUG [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700/family2 2023-11-28 14:54:02,891 INFO [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abb9d45cdbc2ef61c7505454675c3700 columnFamilyName family2 2023-11-28 14:54:02,893 INFO [StoreOpener-abb9d45cdbc2ef61c7505454675c3700-1] regionserver.HStore(310): Store=abb9d45cdbc2ef61c7505454675c3700/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:02,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:02,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:02,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:54:02,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:54:02,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:02,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened abb9d45cdbc2ef61c7505454675c3700; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61219661, jitterRate=-0.0877559632062912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:54:02,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for abb9d45cdbc2ef61c7505454675c3700: 2023-11-28 14:54:02,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700., pid=32, masterSystemTime=1701183242880 2023-11-28 14:54:02,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:02,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:02,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:02,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 57c598eec81de40a9c00524003304d89, NAME => 'testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89.', STARTKEY => '2', ENDKEY => ''} 2023-11-28 14:54:02,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 57c598eec81de40a9c00524003304d89 2023-11-28 14:54:02,904 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=abb9d45cdbc2ef61c7505454675c3700, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:02,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:02,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 57c598eec81de40a9c00524003304d89 2023-11-28 14:54:02,904 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701183242904"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183242904"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183242904"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183242904"}]},"ts":"1701183242904"} 2023-11-28 14:54:02,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 57c598eec81de40a9c00524003304d89 2023-11-28 14:54:02,906 INFO [StoreOpener-57c598eec81de40a9c00524003304d89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 57c598eec81de40a9c00524003304d89 2023-11-28 14:54:02,907 DEBUG [StoreOpener-57c598eec81de40a9c00524003304d89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1 2023-11-28 14:54:02,907 DEBUG [StoreOpener-57c598eec81de40a9c00524003304d89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1 2023-11-28 14:54:02,908 INFO [StoreOpener-57c598eec81de40a9c00524003304d89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c598eec81de40a9c00524003304d89 columnFamilyName family1 2023-11-28 14:54:02,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=32, resume processing ppid=28 2023-11-28 14:54:02,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure abb9d45cdbc2ef61c7505454675c3700, server=jenkins-hbase4.apache.org,41403,1701183201531 in 178 msec 2023-11-28 14:54:02,909 INFO [StoreOpener-57c598eec81de40a9c00524003304d89-1] regionserver.HStore(310): Store=57c598eec81de40a9c00524003304d89/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:02,909 INFO [StoreOpener-57c598eec81de40a9c00524003304d89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 57c598eec81de40a9c00524003304d89 2023-11-28 14:54:02,910 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=abb9d45cdbc2ef61c7505454675c3700, ASSIGN in 339 msec 2023-11-28 14:54:02,911 DEBUG [StoreOpener-57c598eec81de40a9c00524003304d89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family2 2023-11-28 14:54:02,911 DEBUG [StoreOpener-57c598eec81de40a9c00524003304d89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family2 2023-11-28 14:54:02,912 INFO [StoreOpener-57c598eec81de40a9c00524003304d89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57c598eec81de40a9c00524003304d89 columnFamilyName family2 2023-11-28 14:54:02,913 INFO [StoreOpener-57c598eec81de40a9c00524003304d89-1] regionserver.HStore(310): Store=57c598eec81de40a9c00524003304d89/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:02,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89 2023-11-28 14:54:02,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89 2023-11-28 14:54:02,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:54:02,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 57c598eec81de40a9c00524003304d89 2023-11-28 14:54:02,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:02,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 57c598eec81de40a9c00524003304d89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70500343, jitterRate=0.050536975264549255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:54:02,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 57c598eec81de40a9c00524003304d89: 2023-11-28 14:54:02,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89., pid=31, masterSystemTime=1701183242880 2023-11-28 14:54:02,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:02,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:02,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:02,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c0faa1ee29720150b9862889d03d38b, NAME => 'testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b.', STARTKEY => '1', ENDKEY => '2'} 2023-11-28 14:54:02,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:02,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:02,921 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=57c598eec81de40a9c00524003304d89, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:02,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:02,921 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:02,921 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701183242921"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183242921"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183242921"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183242921"}]},"ts":"1701183242921"} 2023-11-28 14:54:02,922 INFO [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:02,924 DEBUG [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b/family1 2023-11-28 14:54:02,924 DEBUG [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b/family1 2023-11-28 14:54:02,924 INFO [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c0faa1ee29720150b9862889d03d38b columnFamilyName family1 2023-11-28 14:54:02,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=31, resume processing ppid=30 2023-11-28 14:54:02,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 57c598eec81de40a9c00524003304d89, server=jenkins-hbase4.apache.org,41403,1701183201531 in 196 msec 2023-11-28 14:54:02,925 INFO [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] regionserver.HStore(310): Store=8c0faa1ee29720150b9862889d03d38b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:02,926 INFO [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:02,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=57c598eec81de40a9c00524003304d89, ASSIGN in 355 msec 2023-11-28 14:54:02,927 DEBUG [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b/family2 2023-11-28 14:54:02,927 DEBUG [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b/family2 2023-11-28 14:54:02,927 INFO [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c0faa1ee29720150b9862889d03d38b columnFamilyName family2 2023-11-28 14:54:02,928 INFO [StoreOpener-8c0faa1ee29720150b9862889d03d38b-1] regionserver.HStore(310): Store=8c0faa1ee29720150b9862889d03d38b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:02,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:02,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:02,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:54:02,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:54:02,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:02,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8c0faa1ee29720150b9862889d03d38b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69165170, jitterRate=0.0306413471698761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:54:02,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8c0faa1ee29720150b9862889d03d38b: 2023-11-28 14:54:02,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b., pid=33, masterSystemTime=1701183242880 2023-11-28 14:54:02,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:02,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:02,936 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8c0faa1ee29720150b9862889d03d38b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:02,936 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701183242936"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183242936"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183242936"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183242936"}]},"ts":"1701183242936"} 2023-11-28 14:54:02,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=33, resume processing ppid=29 2023-11-28 14:54:02,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 8c0faa1ee29720150b9862889d03d38b, server=jenkins-hbase4.apache.org,41403,1701183201531 in 210 msec 2023-11-28 14:54:02,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=29, resume processing ppid=27 2023-11-28 14:54:02,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8c0faa1ee29720150b9862889d03d38b, ASSIGN in 369 msec 2023-11-28 14:54:02,942 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:54:02,942 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183242942"}]},"ts":"1701183242942"} 2023-11-28 14:54:02,943 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-28 14:54:02,947 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:54:02,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2230 sec 2023-11-28 14:54:03,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-28 14:54:03,835 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-28 14:54:03,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:03,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:03,843 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-28 14:54:03,843 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:03,843 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-28 14:54:03,843 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-28 14:54:03,844 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:03,844 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:03,845 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:03,845 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:03,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:03,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:03,845 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:03,846 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:03,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:03,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:03,846 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:03,846 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:03,846 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-28 14:54:03,847 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:03,847 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-28 14:54:03,847 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:03,847 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. started... 2023-11-28 14:54:03,847 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:03,847 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:54:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:03,848 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:03,847 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. started... 2023-11-28 14:54:03,848 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. started... 2023-11-28 14:54:03,848 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for abb9d45cdbc2ef61c7505454675c3700: 2023-11-28 14:54:03,848 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 57c598eec81de40a9c00524003304d89 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-28 14:54:03,849 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8c0faa1ee29720150b9862889d03d38b: 2023-11-28 14:54:03,848 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:03,849 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:03,849 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:54:03,849 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:54:04,262 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311284b8b0730a7b044018c03e841fbd9f8fa to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311284b8b0730a7b044018c03e841fbd9f8fa 2023-11-28 14:54:04,668 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/.tmp/family1/70ea66a1141c45f0bc0f2c5a97f05203 2023-11-28 14:54:04,673 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/.tmp/family1/70ea66a1141c45f0bc0f2c5a97f05203 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/70ea66a1141c45f0bc0f2c5a97f05203 2023-11-28 14:54:04,679 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/70ea66a1141c45f0bc0f2c5a97f05203, entries=1, sequenceid=5, filesize=4.9 K 2023-11-28 14:54:04,680 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 57c598eec81de40a9c00524003304d89 in 832ms, sequenceid=5, compaction requested=false 2023-11-28 14:54:04,680 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-28 14:54:04,680 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-28 14:54:04,682 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 57c598eec81de40a9c00524003304d89: 2023-11-28 14:54:04,682 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:04,682 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:54:04,682 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:54:04,682 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,682 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-28 14:54:04,682 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-28 14:54:04,684 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,684 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:04,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:04,684 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,684 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:04,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:04,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:04,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:04,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-28 14:54:04,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d060621[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:04,686 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-28 14:54:04,686 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,688 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,688 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-28 14:54:04,688 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-28 14:54:04,688 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:04,688 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,688 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:04,691 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-28 14:54:04,691 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:04,691 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,691 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-28 14:54:04,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:04,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:04,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:04,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-28 14:54:04,694 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-28 14:54:04,694 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:04,694 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:04,694 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,694 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:04,696 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,696 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:04,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,697 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:04,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:04,697 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,699 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:04,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:04,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:04,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-28 14:54:04,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:04,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-28 14:54:04,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,702 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:04,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:04,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,702 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:04,703 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:04,703 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,703 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:04,803 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:04,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:04,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:04,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:04,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,811 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-28 14:54:04,811 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:04,811 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-28 14:54:04,811 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-28 14:54:04,811 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,811 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,813 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:04,813 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:04,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:04,813 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:04,813 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:04,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:04,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,814 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,814 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-28 14:54:04,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:04,815 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-28 14:54:04,815 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:04,815 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-28 14:54:04,816 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:04,816 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. started... 2023-11-28 14:54:04,816 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:04,816 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for abb9d45cdbc2ef61c7505454675c3700: 2023-11-28 14:54:04,816 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:54:04,816 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. started... 2023-11-28 14:54:04,817 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 57c598eec81de40a9c00524003304d89 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-28 14:54:04,819 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:54:04,819 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:04,819 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:04,819 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:54:04,819 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. started... 2023-11-28 14:54:04,820 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 8c0faa1ee29720150b9862889d03d38b: 2023-11-28 14:54:04,820 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:54:04,820 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:54:05,233 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311284f5af61a64ba42dfad248bba2c844c06 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311284f5af61a64ba42dfad248bba2c844c06 2023-11-28 14:54:05,639 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/.tmp/family1/983bfe7ee63a487dbd3c7da13a867eff 2023-11-28 14:54:05,645 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/.tmp/family1/983bfe7ee63a487dbd3c7da13a867eff as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/983bfe7ee63a487dbd3c7da13a867eff 2023-11-28 14:54:05,650 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/983bfe7ee63a487dbd3c7da13a867eff, entries=2, sequenceid=9, filesize=5.0 K 2023-11-28 14:54:05,651 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 57c598eec81de40a9c00524003304d89 in 834ms, sequenceid=9, compaction requested=false 2023-11-28 14:54:05,651 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 57c598eec81de40a9c00524003304d89: 2023-11-28 14:54:05,651 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:05,651 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:54:05,651 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:54:05,651 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,651 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-28 14:54:05,651 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-28 14:54:05,654 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,654 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:05,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:05,655 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,655 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:05,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:05,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:05,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:05,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-28 14:54:05,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@101a1d04[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:05,656 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-28 14:54:05,656 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,658 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-28 14:54:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-28 14:54:05,658 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:05,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,658 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:05,660 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-28 14:54:05,660 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,660 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:05,660 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-28 14:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:05,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-28 14:54:05,663 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-28 14:54:05,663 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:05,663 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:05,663 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,663 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:05,665 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,665 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,665 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:05,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:05,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:05,665 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,667 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,675 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:05,675 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:05,675 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:05,675 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:05,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-28 14:54:05,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:05,675 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,676 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,676 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:05,676 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,676 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,676 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:05,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:05,676 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:05,676 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:05,776 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:05,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:05,784 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-28 14:54:05,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-28 14:54:05,786 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-28 14:54:05,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:05,787 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183845787 2023-11-28 14:54:05,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:54:05,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-28 14:54:05,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-28 14:54:05,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x01e59e02 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:05,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@183b14b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:05,794 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231128 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-28 14:54:06,624 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112880abf18295114aadbea95b5108e4a7ce to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023112880abf18295114aadbea95b5108e4a7ce 2023-11-28 14:54:06,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-28 14:54:06,639 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:54:06,640 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:54:06,647 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:54:06,650 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:54:06,659 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231128/family1/ba4f5a8c78ff45ddb5d339b39c95aaba first=Optional[k0] last=Optional[k1] 2023-11-28 14:54:06,660 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231128/family1/ba4f5a8c78ff45ddb5d339b39c95aaba}] 2023-11-28 14:54:06,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231128/family1/ba4f5a8c78ff45ddb5d339b39c95aaba for inclusion in 57c598eec81de40a9c00524003304d89/family1 2023-11-28 14:54:06,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-28 14:54:06,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-28 14:54:06,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 57c598eec81de40a9c00524003304d89: 2023-11-28 14:54:06,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231128/family1/ba4f5a8c78ff45ddb5d339b39c95aaba to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testScannerOnBulkLoadRefHFiles__ukjmlth9occb44cp24gs20llf8daouj0fu2idi61gt9joqvsdnicse2fortnmrng/family1/ba4f5a8c78ff45ddb5d339b39c95aaba 2023-11-28 14:54:06,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testScannerOnBulkLoadRefHFiles__ukjmlth9occb44cp24gs20llf8daouj0fu2idi61gt9joqvsdnicse2fortnmrng/family1/ba4f5a8c78ff45ddb5d339b39c95aaba as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/9f6bcfcb87f14a6b979992d3e4b0993c_SeqId_12_ 2023-11-28 14:54:06,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testScannerOnBulkLoadRefHFiles__ukjmlth9occb44cp24gs20llf8daouj0fu2idi61gt9joqvsdnicse2fortnmrng/family1/ba4f5a8c78ff45ddb5d339b39c95aaba into 57c598eec81de40a9c00524003304d89/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/9f6bcfcb87f14a6b979992d3e4b0993c_SeqId_12_ - updating store file list. 2023-11-28 14:54:06,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/9f6bcfcb87f14a6b979992d3e4b0993c_SeqId_12_ into 57c598eec81de40a9c00524003304d89/family1 2023-11-28 14:54:06,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testScannerOnBulkLoadRefHFiles__ukjmlth9occb44cp24gs20llf8daouj0fu2idi61gt9joqvsdnicse2fortnmrng/family1/ba4f5a8c78ff45ddb5d339b39c95aaba into 57c598eec81de40a9c00524003304d89/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/9f6bcfcb87f14a6b979992d3e4b0993c_SeqId_12_) 2023-11-28 14:54:06,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testScannerOnBulkLoadRefHFiles__ukjmlth9occb44cp24gs20llf8daouj0fu2idi61gt9joqvsdnicse2fortnmrng/family1/ba4f5a8c78ff45ddb5d339b39c95aaba 2023-11-28 14:54:06,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-28 14:54:06,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-28 14:54:06,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): 57c598eec81de40a9c00524003304d89/family1 is initiating minor compaction (all files) 2023-11-28 14:54:06,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7cce7cb2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:06,677 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 57c598eec81de40a9c00524003304d89/family1 in testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:54:06,677 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/70ea66a1141c45f0bc0f2c5a97f05203, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/983bfe7ee63a487dbd3c7da13a867eff, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/9f6bcfcb87f14a6b979992d3e4b0993c_SeqId_12_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/.tmp, totalSize=15.1 K 2023-11-28 14:54:06,677 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 70ea66a1141c45f0bc0f2c5a97f05203, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183243835 2023-11-28 14:54:06,678 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 983bfe7ee63a487dbd3c7da13a867eff, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183243835 2023-11-28 14:54:06,679 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 9f6bcfcb87f14a6b979992d3e4b0993c_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183243835 2023-11-28 14:54:06,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-28 14:54:06,680 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:06,682 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311284b8b0730a7b044018c03e841fbd9f8fa to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311284b8b0730a7b044018c03e841fbd9f8fa 2023-11-28 14:54:06,683 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311284f5af61a64ba42dfad248bba2c844c06 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311284f5af61a64ba42dfad248bba2c844c06 2023-11-28 14:54:06,683 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-28 14:54:06,683 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231128' 2023-11-28 14:54:06,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231128 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-28 14:54:06,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-28 14:54:06,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:06,685 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-28 14:54:06,686 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 900 msec 2023-11-28 14:54:06,690 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): 57c598eec81de40a9c00524003304d89#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:54:06,718 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=257 (was 256) - Thread LEAK? -, OpenFileDescriptor=641 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 252), ProcessCount=172 (was 172), AvailableMemoryMB=7732 (was 7748) 2023-11-28 14:54:06,729 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=257, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=241, ProcessCount=172, AvailableMemoryMB=7731 2023-11-28 14:54:06,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-28 14:54:06,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:06,733 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:54:06,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-28 14:54:06,734 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:54:06,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-28 14:54:06,736 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:54:06,736 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef empty. 2023-11-28 14:54:06,737 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:54:06,737 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-28 14:54:06,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-28 14:54:07,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-28 14:54:07,146 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-28 14:54:07,147 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => f3c7b6ddba4fb335b7b80f9c108e93ef, NAME => 'testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:07,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-28 14:54:07,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:07,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing f3c7b6ddba4fb335b7b80f9c108e93ef, disabling compactions & flushes 2023-11-28 14:54:07,553 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:07,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:07,553 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. after waiting 0 ms 2023-11-28 14:54:07,554 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:07,554 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:07,554 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:07,556 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:54:07,557 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701183247557"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183247557"}]},"ts":"1701183247557"} 2023-11-28 14:54:07,558 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-28 14:54:07,559 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:54:07,559 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183247559"}]},"ts":"1701183247559"} 2023-11-28 14:54:07,560 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-28 14:54:07,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f3c7b6ddba4fb335b7b80f9c108e93ef, ASSIGN}] 2023-11-28 14:54:07,565 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f3c7b6ddba4fb335b7b80f9c108e93ef, ASSIGN 2023-11-28 14:54:07,565 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f3c7b6ddba4fb335b7b80f9c108e93ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:07,717 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f3c7b6ddba4fb335b7b80f9c108e93ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:07,717 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701183247716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183247716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183247716"}]},"ts":"1701183247716"} 2023-11-28 14:54:07,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure f3c7b6ddba4fb335b7b80f9c108e93ef, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:07,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-28 14:54:07,870 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:07,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:07,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f3c7b6ddba4fb335b7b80f9c108e93ef, NAME => 'testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:54:07,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:54:07,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:07,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:54:07,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:54:07,876 INFO [StoreOpener-f3c7b6ddba4fb335b7b80f9c108e93ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:54:07,877 DEBUG [StoreOpener-f3c7b6ddba4fb335b7b80f9c108e93ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1 2023-11-28 14:54:07,877 DEBUG [StoreOpener-f3c7b6ddba4fb335b7b80f9c108e93ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1 2023-11-28 14:54:07,878 INFO [StoreOpener-f3c7b6ddba4fb335b7b80f9c108e93ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3c7b6ddba4fb335b7b80f9c108e93ef columnFamilyName family1 2023-11-28 14:54:07,879 INFO [StoreOpener-f3c7b6ddba4fb335b7b80f9c108e93ef-1] regionserver.HStore(310): Store=f3c7b6ddba4fb335b7b80f9c108e93ef/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:07,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:54:07,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:54:07,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:54:07,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:07,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f3c7b6ddba4fb335b7b80f9c108e93ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73046891, jitterRate=0.08848349750041962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:54:07,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:07,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef., pid=37, masterSystemTime=1701183247870 2023-11-28 14:54:07,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:07,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:07,888 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f3c7b6ddba4fb335b7b80f9c108e93ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:07,889 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701183247888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183247888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183247888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183247888"}]},"ts":"1701183247888"} 2023-11-28 14:54:07,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=37, resume processing ppid=36 2023-11-28 14:54:07,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure f3c7b6ddba4fb335b7b80f9c108e93ef, server=jenkins-hbase4.apache.org,41403,1701183201531 in 171 msec 2023-11-28 14:54:07,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=36, resume processing ppid=35 2023-11-28 14:54:07,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f3c7b6ddba4fb335b7b80f9c108e93ef, ASSIGN in 329 msec 2023-11-28 14:54:07,894 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:54:07,894 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183247894"}]},"ts":"1701183247894"} 2023-11-28 14:54:07,895 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-28 14:54:07,897 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:54:07,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1660 sec 2023-11-28 14:54:07,913 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/.tmp/family1/5b095580a2034c7d85cd7adb7fc505f4 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/5b095580a2034c7d85cd7adb7fc505f4 2023-11-28 14:54:07,919 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 57c598eec81de40a9c00524003304d89/family1 of 57c598eec81de40a9c00524003304d89 into 5b095580a2034c7d85cd7adb7fc505f4(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:54:07,919 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 57c598eec81de40a9c00524003304d89: 2023-11-28 14:54:07,919 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1701183246677; duration=1sec 2023-11-28 14:54:07,919 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:08,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/70ea66a1141c45f0bc0f2c5a97f05203, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/983bfe7ee63a487dbd3c7da13a867eff, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/9f6bcfcb87f14a6b979992d3e4b0993c_SeqId_12_] to archive 2023-11-28 14:54:08,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:08,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/70ea66a1141c45f0bc0f2c5a97f05203 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/70ea66a1141c45f0bc0f2c5a97f05203 2023-11-28 14:54:08,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/983bfe7ee63a487dbd3c7da13a867eff to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/983bfe7ee63a487dbd3c7da13a867eff 2023-11-28 14:54:08,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/9f6bcfcb87f14a6b979992d3e4b0993c_SeqId_12_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/family1/9f6bcfcb87f14a6b979992d3e4b0993c_SeqId_12_ 2023-11-28 14:54:08,386 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:54:08,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-28 14:54:08,840 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-28 14:54:08,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:08,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:08,872 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:08,872 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:08,872 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:08,872 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:08,873 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:08,873 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:08,875 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:08,875 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:08,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:08,875 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:08,875 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:08,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:08,876 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:08,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:08,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:08,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:08,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:08,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:08,877 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:08,877 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:08,877 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:08,878 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-28 14:54:09,300 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130dc50d61ef2f840a2a52372dac3b34a3e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130dc50d61ef2f840a2a52372dac3b34a3e 2023-11-28 14:54:09,704 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/d98dda2d96e24b3ebec25790b61b060d 2023-11-28 14:54:09,709 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/d98dda2d96e24b3ebec25790b61b060d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/d98dda2d96e24b3ebec25790b61b060d 2023-11-28 14:54:09,715 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/d98dda2d96e24b3ebec25790b61b060d, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-28 14:54:09,716 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 838ms, sequenceid=5, compaction requested=false 2023-11-28 14:54:09,716 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:09,716 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:09,716 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:09,716 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:09,717 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:09,717 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,717 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:09,717 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:09,718 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,718 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:09,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:09,719 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,719 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:09,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:09,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:09,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:09,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:09,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f84a2fc[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:09,720 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:09,720 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,721 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:09,721 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:09,722 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,722 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:09,723 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:09,723 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,723 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:09,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:09,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:09,723 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:09,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:09,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:09,725 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:09,725 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:09,725 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:09,725 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,725 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:09,727 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,727 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,727 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:09,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:09,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:09,728 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,730 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,732 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,732 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,732 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,732 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:09,732 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:09,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:09,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:09,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:09,732 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:09,732 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:09,733 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,733 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,733 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:09,733 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,733 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:09,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:09,833 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:09,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:09,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:09,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:09,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,840 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:09,840 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:09,840 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:09,840 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:09,841 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,841 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,842 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:09,842 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:09,842 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:09,842 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,843 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,843 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:54:09,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:09,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:09,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:09,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:09,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:09,844 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:09,844 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:09,844 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:09,844 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-28 14:54:10,257 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f7590faf800e40108d237965339426a8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128f7590faf800e40108d237965339426a8 2023-11-28 14:54:10,663 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/2cf6949f94724f2fb820827ea29842cd 2023-11-28 14:54:10,669 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/2cf6949f94724f2fb820827ea29842cd as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2cf6949f94724f2fb820827ea29842cd 2023-11-28 14:54:10,673 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2cf6949f94724f2fb820827ea29842cd, entries=1, sequenceid=9, filesize=5.0 K 2023-11-28 14:54:10,674 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 830ms, sequenceid=9, compaction requested=false 2023-11-28 14:54:10,674 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:10,674 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:10,674 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:10,674 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:10,674 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,674 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:10,674 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:10,676 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,676 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:10,676 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,676 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:10,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:10,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:10,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ef2f86e[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:10,678 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:10,678 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,680 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:10,680 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,680 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:10,681 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:10,681 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:10,681 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,682 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:10,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:10,684 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:10,684 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:10,684 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:10,684 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,684 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:10,686 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,686 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:10,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,686 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:10,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:10,686 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,688 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:10,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:10,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:54:10,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:10,690 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:10,690 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:10,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:10,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:10,790 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:10,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:10,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:10,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:10,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,797 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:10,797 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:10,797 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:10,797 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:10,798 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,798 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:10,803 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:10,803 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:10,803 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,804 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,804 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:54:10,804 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:10,805 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:10,805 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:10,805 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:10,805 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:10,805 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:10,805 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:10,805 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:10,805 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:11,218 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013b70b8f9d0934957a50decf50660e29c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013b70b8f9d0934957a50decf50660e29c 2023-11-28 14:54:11,624 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/1c2c6b38c8b74521a8f1ffb45c8860d0 2023-11-28 14:54:11,629 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/1c2c6b38c8b74521a8f1ffb45c8860d0 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1c2c6b38c8b74521a8f1ffb45c8860d0 2023-11-28 14:54:11,633 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1c2c6b38c8b74521a8f1ffb45c8860d0, entries=1, sequenceid=13, filesize=4.9 K 2023-11-28 14:54:11,634 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 829ms, sequenceid=13, compaction requested=true 2023-11-28 14:54:11,634 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:11,634 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:11,636 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,636 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:11,636 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,636 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:11,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:11,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3328ca9f[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:11,638 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:11,638 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,639 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,639 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:11,639 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:11,639 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:11,639 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,639 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:11,640 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,640 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:11,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:11,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:11,640 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:11,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:11,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:11,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:11,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:11,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:11,643 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:11,643 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:11,643 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:11,643 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,643 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:11,645 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,645 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,646 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:11,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:11,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:11,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:11,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:11,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:11,646 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,647 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:11,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:54:11,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:11,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:11,650 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:11,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:11,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,651 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:11,751 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:11,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:11,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:11,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:11,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,758 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:11,758 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:11,758 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:11,758 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:11,758 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,758 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,759 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,759 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:11,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:11,760 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:11,760 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,761 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,761 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:54:11,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:11,761 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:11,761 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:11,761 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:11,761 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:11,761 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:11,761 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:11,761 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:11,761 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:12,177 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fb5ffd09af2b4a77a0776734ea3a1d01 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb5ffd09af2b4a77a0776734ea3a1d01 2023-11-28 14:54:12,583 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/87291d8aa28b4927a8a5c6d6760cdd80 2023-11-28 14:54:12,588 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/87291d8aa28b4927a8a5c6d6760cdd80 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/87291d8aa28b4927a8a5c6d6760cdd80 2023-11-28 14:54:12,592 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/87291d8aa28b4927a8a5c6d6760cdd80, entries=1, sequenceid=17, filesize=4.9 K 2023-11-28 14:54:12,593 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 832ms, sequenceid=17, compaction requested=true 2023-11-28 14:54:12,593 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:12,594 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:12,595 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,595 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:12,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:12,596 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,596 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:12,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:12,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:12,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:12,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:12,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@739a13c3[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:12,598 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:12,598 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,600 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,601 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:12,601 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:12,601 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:12,601 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,601 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:12,602 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:12,602 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:12,602 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,602 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:12,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:12,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:12,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:12,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:12,605 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:12,605 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:12,605 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:12,605 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,605 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:12,606 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,606 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:12,606 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:12,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:12,607 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,609 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:12,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,611 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,611 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,611 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,611 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:12,611 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:12,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:54:12,611 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:12,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:12,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:12,611 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:12,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:12,612 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:12,612 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:12,611 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,612 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,612 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:12,712 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:12,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:12,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:12,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:12,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,719 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:12,719 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:12,719 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:12,719 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:12,719 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,719 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,722 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:12,722 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:12,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:12,722 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:12,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,722 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:12,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:12,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,723 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,723 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:54:12,723 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:12,724 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:12,724 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:12,724 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:12,724 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:12,724 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:12,724 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:12,724 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:12,724 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:13,138 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122887d2345779814e26a41f987f7b70ec21 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122887d2345779814e26a41f987f7b70ec21 2023-11-28 14:54:13,376 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:54:13,547 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/5e970f216adc44d8ba3dde4416f0309f 2023-11-28 14:54:13,551 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/5e970f216adc44d8ba3dde4416f0309f as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/5e970f216adc44d8ba3dde4416f0309f 2023-11-28 14:54:13,555 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/5e970f216adc44d8ba3dde4416f0309f, entries=1, sequenceid=21, filesize=4.9 K 2023-11-28 14:54:13,556 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 832ms, sequenceid=21, compaction requested=true 2023-11-28 14:54:13,556 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:13,556 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:13,556 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:13,557 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:13,557 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,557 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:13,557 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:13,559 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,559 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:13,559 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,559 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:13,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:13,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7903dc0e[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:13,560 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:13,560 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,562 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,562 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:13,562 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:13,562 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:13,562 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,562 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:13,563 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,563 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:13,563 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:13,563 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:13,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:13,566 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:13,566 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:13,566 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:13,566 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,566 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:13,568 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,568 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:13,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,569 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:13,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:13,569 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:13,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,570 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,575 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,575 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:13,575 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:13,576 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:13,575 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:13,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:13,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:13,576 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,576 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,576 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,576 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,576 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:13,576 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:13,576 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:13,676 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:13,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:13,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:13,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:13,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,683 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:13,683 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:13,683 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:13,683 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:13,684 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,684 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,685 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,685 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:13,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:13,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:13,686 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:13,686 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:13,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:13,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,686 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,687 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:54:13,687 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:13,687 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:13,687 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:13,687 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:13,687 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:13,687 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:13,687 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:13,687 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:13,687 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:14,100 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231080e9f8d263d4fbb80541353ebdcb521 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231080e9f8d263d4fbb80541353ebdcb521 2023-11-28 14:54:14,506 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/33e61dda4eb040e2bf462553bfd589a2 2023-11-28 14:54:14,511 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/33e61dda4eb040e2bf462553bfd589a2 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/33e61dda4eb040e2bf462553bfd589a2 2023-11-28 14:54:14,515 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/33e61dda4eb040e2bf462553bfd589a2, entries=1, sequenceid=25, filesize=4.9 K 2023-11-28 14:54:14,516 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 829ms, sequenceid=25, compaction requested=true 2023-11-28 14:54:14,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:14,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:14,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:14,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:14,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:14,516 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:14,519 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,519 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:14,519 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:14,519 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:14,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:14,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30fb7ac8[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:14,521 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:14,521 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,522 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:14,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:14,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:14,523 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,523 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:14,524 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:14,524 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,524 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:14,524 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:14,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:14,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:14,527 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:14,527 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:14,527 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:14,527 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,527 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:14,529 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,529 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:14,529 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:14,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:14,529 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:14,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,532 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:14,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,535 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,535 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:14,535 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:14,535 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:14,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:14,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:14,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:14,535 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,535 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:14,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:14,536 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:14,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:14,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,536 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:14,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,636 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:14,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:14,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:14,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:14,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,643 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:14,643 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:14,643 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:14,643 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:14,644 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,644 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,645 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:14,645 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:14,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:14,646 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:14,646 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:14,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:14,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,646 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:54:14,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:14,647 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:14,647 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:14,647 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:14,647 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:14,647 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:14,647 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:14,647 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:14,647 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:15,061 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d1b0159d48dd4ac8a647b249a67b2b6e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101d1b0159d48dd4ac8a647b249a67b2b6e 2023-11-28 14:54:15,467 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/7e25a1d314e34501a18528824bacc80f 2023-11-28 14:54:15,471 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/7e25a1d314e34501a18528824bacc80f as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/7e25a1d314e34501a18528824bacc80f 2023-11-28 14:54:15,475 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/7e25a1d314e34501a18528824bacc80f, entries=1, sequenceid=29, filesize=4.9 K 2023-11-28 14:54:15,476 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 829ms, sequenceid=29, compaction requested=true 2023-11-28 14:54:15,476 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:15,476 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:15,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:15,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:15,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:15,477 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:15,478 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,478 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:15,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:15,479 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,479 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:15,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:15,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:15,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:15,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:15,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4572327a[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:15,480 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:15,480 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,481 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:15,481 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:15,482 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,482 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:15,484 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:15,484 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,484 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:15,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:15,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:15,484 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:15,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:15,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:15,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:15,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:15,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:15,487 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:15,487 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:15,487 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:15,487 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,487 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:15,488 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,488 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:15,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:15,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,488 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:15,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:15,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:15,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:15,489 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:15,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,490 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:15,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,492 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:15,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:15,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:15,493 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:15,493 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:15,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:15,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:15,593 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:15,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:15,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:15,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:15,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,600 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:15,600 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:15,600 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:15,600 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:15,601 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,601 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,602 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,602 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:15,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:15,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:15,602 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:15,603 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:15,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:15,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,604 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,604 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:54:15,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:15,604 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:15,604 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:15,604 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:15,604 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:15,604 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:15,604 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:15,604 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:15,604 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:16,019 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a1706b45bbd646399dea8cec1126fba0 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1706b45bbd646399dea8cec1126fba0 2023-11-28 14:54:16,425 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/1ac52fde1a094211b2adcf1cb2ba4926 2023-11-28 14:54:16,431 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/1ac52fde1a094211b2adcf1cb2ba4926 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1ac52fde1a094211b2adcf1cb2ba4926 2023-11-28 14:54:16,435 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1ac52fde1a094211b2adcf1cb2ba4926, entries=1, sequenceid=33, filesize=4.9 K 2023-11-28 14:54:16,436 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 832ms, sequenceid=33, compaction requested=true 2023-11-28 14:54:16,436 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:16,436 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:16,436 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:16,436 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:16,436 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,436 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:16,436 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:16,439 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,439 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:16,440 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,440 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:16,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:16,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:16,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:16,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6655251c[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:16,442 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:16,442 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,443 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,443 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:16,443 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:16,443 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:16,443 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,443 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:16,447 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:16,447 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,447 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:16,447 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:16,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:16,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:16,450 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:16,450 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:16,450 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:16,450 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,450 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:16,454 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,454 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:16,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:16,454 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:16,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:16,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:16,454 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:16,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:16,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,456 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:16,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:16,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:16,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:16,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:16,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,458 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:16,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:54:16,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:16,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:16,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:16,458 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:16,459 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:16,459 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:16,559 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:16,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:16,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:16,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:16,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,567 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:16,567 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:16,567 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:16,567 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:16,567 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,567 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,574 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,574 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:16,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:16,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:16,574 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:16,574 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:16,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:16,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,575 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,576 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:54:16,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:16,576 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:16,576 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:16,576 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:16,577 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:16,992 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090747dfb31fdbeb4c3a80c3f219bcddc8f4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090747dfb31fdbeb4c3a80c3f219bcddc8f4 2023-11-28 14:54:17,399 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/b8a375ea5df84fff895b8881841c645c 2023-11-28 14:54:17,404 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/b8a375ea5df84fff895b8881841c645c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/b8a375ea5df84fff895b8881841c645c 2023-11-28 14:54:17,408 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/b8a375ea5df84fff895b8881841c645c, entries=1, sequenceid=37, filesize=4.9 K 2023-11-28 14:54:17,409 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 832ms, sequenceid=37, compaction requested=true 2023-11-28 14:54:17,409 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:17,409 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:17,409 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:17,409 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:17,409 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,410 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:17,410 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:17,411 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,411 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:17,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:17,412 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,412 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:17,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:17,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1517674[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:17,413 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:17,413 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,415 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,415 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:17,415 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:17,415 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:17,415 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,416 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:17,417 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:17,417 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,417 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,417 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:17,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:17,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:17,420 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:17,420 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:17,420 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:17,420 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,420 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:17,421 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,421 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,421 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:17,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:17,422 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,423 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,426 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,426 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,426 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,426 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:17,426 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:17,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:17,426 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:17,426 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,426 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,426 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:17,426 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:17,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:54:17,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:17,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:17,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:17,427 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:17,427 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:17,527 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:17,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:17,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:17,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:17,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,534 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:17,534 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:17,534 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-28 14:54:17,535 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-28 14:54:17,535 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,535 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,537 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,537 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:17,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:17,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:17,538 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:17,538 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:17,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:17,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,538 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,539 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-28 14:54:17,539 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:17,539 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-28 14:54:17,539 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:17,539 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-28 14:54:17,539 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:17,539 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:17,539 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:17,539 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. started... 2023-11-28 14:54:17,539 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f3c7b6ddba4fb335b7b80f9c108e93ef 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:17,953 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ce61b957a692481498766da25acec59d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120ce61b957a692481498766da25acec59d 2023-11-28 14:54:18,359 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/2a495760b35f4aff8b8e6f944aafd14f 2023-11-28 14:54:18,363 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/2a495760b35f4aff8b8e6f944aafd14f as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2a495760b35f4aff8b8e6f944aafd14f 2023-11-28 14:54:18,367 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2a495760b35f4aff8b8e6f944aafd14f, entries=1, sequenceid=41, filesize=4.9 K 2023-11-28 14:54:18,368 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f3c7b6ddba4fb335b7b80f9c108e93ef in 829ms, sequenceid=41, compaction requested=true 2023-11-28 14:54:18,368 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:18,368 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-28 14:54:18,368 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-28 14:54:18,370 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,370 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:18,370 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,370 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:18,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:18,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:18,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:18,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-28 14:54:18,372 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-28 14:54:18,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a9761ac[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:18,372 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,373 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,373 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-28 14:54:18,374 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-28 14:54:18,374 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:18,374 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,374 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-28 14:54:18,376 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,376 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-28 14:54:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:18,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:18,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:54:18,379 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-28 14:54:18,379 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:18,379 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:18,379 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,379 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:18,380 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,380 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,380 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:18,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:18,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:18,381 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,382 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:18,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,385 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,385 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,385 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:18,385 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:18,385 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:18,385 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:18,385 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:18,385 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-28 14:54:18,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:18,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:18,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-28 14:54:18,385 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,386 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,386 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:18,386 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:18,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:18,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:18,486 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:18,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:18,488 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-28 14:54:18,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:54:18,490 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:54:18,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:18,491 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183858491 2023-11-28 14:54:18,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:54:18,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-28 14:54:18,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:18,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x7f6838a3 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:18,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8d817cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:18,500 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:18,537 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:54:18,537 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6670dd90 to 127.0.0.1:62725 2023-11-28 14:54:18,537 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:18,538 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:54:18,538 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x249a163a to 127.0.0.1:62725 2023-11-28 14:54:18,538 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:18,538 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:54:18,538 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32a82889 to 127.0.0.1:62725 2023-11-28 14:54:18,538 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:18,538 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:54:18,538 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01e59e02 to 127.0.0.1:62725 2023-11-28 14:54:18,538 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:19,367 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034ac4b9498453489cba1aec802d2ccea8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601034ac4b9498453489cba1aec802d2ccea8 2023-11-28 14:54:19,368 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:19,389 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:54:19,390 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:54:19,397 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:54:19,398 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:54:19,407 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b40faf4921e54040a6bf7fcd7d748e16 first=Optional[r3] last=Optional[r6] 2023-11-28 14:54:19,407 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b40faf4921e54040a6bf7fcd7d748e16}] 2023-11-28 14:54:19,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b40faf4921e54040a6bf7fcd7d748e16 for inclusion in f3c7b6ddba4fb335b7b80f9c108e93ef/family1 2023-11-28 14:54:19,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-28 14:54:19,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:19,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:19,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b40faf4921e54040a6bf7fcd7d748e16 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__r045g33nb46cd3e8jgg4763n97l9k96ibe0i9tajg10om9kq6qrmodft845fq05i/family1/b40faf4921e54040a6bf7fcd7d748e16 2023-11-28 14:54:19,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__r045g33nb46cd3e8jgg4763n97l9k96ibe0i9tajg10om9kq6qrmodft845fq05i/family1/b40faf4921e54040a6bf7fcd7d748e16 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/3142d7fab32941b89ca2d778458ac135_SeqId_44_ 2023-11-28 14:54:19,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__r045g33nb46cd3e8jgg4763n97l9k96ibe0i9tajg10om9kq6qrmodft845fq05i/family1/b40faf4921e54040a6bf7fcd7d748e16 into f3c7b6ddba4fb335b7b80f9c108e93ef/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/3142d7fab32941b89ca2d778458ac135_SeqId_44_ - updating store file list. 2023-11-28 14:54:19,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/3142d7fab32941b89ca2d778458ac135_SeqId_44_ into f3c7b6ddba4fb335b7b80f9c108e93ef/family1 2023-11-28 14:54:19,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__r045g33nb46cd3e8jgg4763n97l9k96ibe0i9tajg10om9kq6qrmodft845fq05i/family1/b40faf4921e54040a6bf7fcd7d748e16 into f3c7b6ddba4fb335b7b80f9c108e93ef/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/3142d7fab32941b89ca2d778458ac135_SeqId_44_) 2023-11-28 14:54:19,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__r045g33nb46cd3e8jgg4763n97l9k96ibe0i9tajg10om9kq6qrmodft845fq05i/family1/b40faf4921e54040a6bf7fcd7d748e16 2023-11-28 14:54:19,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-28 14:54:19,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-28 14:54:19,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): f3c7b6ddba4fb335b7b80f9c108e93ef/family1 is initiating minor compaction 2023-11-28 14:54:19,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3a76d0ab; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:19,425 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f3c7b6ddba4fb335b7b80f9c108e93ef/family1 in testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:54:19,425 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2cf6949f94724f2fb820827ea29842cd, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1c2c6b38c8b74521a8f1ffb45c8860d0, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/87291d8aa28b4927a8a5c6d6760cdd80, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/5e970f216adc44d8ba3dde4416f0309f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/33e61dda4eb040e2bf462553bfd589a2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/7e25a1d314e34501a18528824bacc80f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1ac52fde1a094211b2adcf1cb2ba4926, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/b8a375ea5df84fff895b8881841c645c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2a495760b35f4aff8b8e6f944aafd14f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/3142d7fab32941b89ca2d778458ac135_SeqId_44_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp, totalSize=50.0 K 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 2cf6949f94724f2fb820827ea29842cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 1c2c6b38c8b74521a8f1ffb45c8860d0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 87291d8aa28b4927a8a5c6d6760cdd80, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 5e970f216adc44d8ba3dde4416f0309f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 33e61dda4eb040e2bf462553bfd589a2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 7e25a1d314e34501a18528824bacc80f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 1ac52fde1a094211b2adcf1cb2ba4926, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting b8a375ea5df84fff895b8881841c645c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 2a495760b35f4aff8b8e6f944aafd14f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-28 14:54:19,426 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 3142d7fab32941b89ca2d778458ac135_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-28 14:54:19,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:19,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:19,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122887d2345779814e26a41f987f7b70ec21 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122887d2345779814e26a41f987f7b70ec21 2023-11-28 14:54:19,431 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231080e9f8d263d4fbb80541353ebdcb521 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231080e9f8d263d4fbb80541353ebdcb521 2023-11-28 14:54:19,432 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101d1b0159d48dd4ac8a647b249a67b2b6e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101d1b0159d48dd4ac8a647b249a67b2b6e 2023-11-28 14:54:19,433 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1706b45bbd646399dea8cec1126fba0 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1706b45bbd646399dea8cec1126fba0 2023-11-28 14:54:19,433 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-28 14:54:19,434 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-28 14:54:19,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:19,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:19,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:19,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:19,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:19,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:19,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:19,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:19,468 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): f3c7b6ddba4fb335b7b80f9c108e93ef#family1#compaction#48 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:54:19,912 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c4d4075394114126bb48336b9b790275 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c4d4075394114126bb48336b9b790275 2023-11-28 14:54:19,913 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:19,941 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9faf6731fc63479a851ee9ce73c467e4 first=Optional[r00] last=Optional[r2] 2023-11-28 14:54:19,941 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9faf6731fc63479a851ee9ce73c467e4}] 2023-11-28 14:54:19,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9faf6731fc63479a851ee9ce73c467e4 for inclusion in f3c7b6ddba4fb335b7b80f9c108e93ef/family1 2023-11-28 14:54:19,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-28 14:54:19,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:19,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:19,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9faf6731fc63479a851ee9ce73c467e4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9p0oe3o8j0d5gkbqsde6tgts70o8inghjdhoj6i7f2ounaubhf77metbro66uhs3/family1/9faf6731fc63479a851ee9ce73c467e4 2023-11-28 14:54:19,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9p0oe3o8j0d5gkbqsde6tgts70o8inghjdhoj6i7f2ounaubhf77metbro66uhs3/family1/9faf6731fc63479a851ee9ce73c467e4 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/043a8c598893443d8306b3041135d226_SeqId_46_ 2023-11-28 14:54:19,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9p0oe3o8j0d5gkbqsde6tgts70o8inghjdhoj6i7f2ounaubhf77metbro66uhs3/family1/9faf6731fc63479a851ee9ce73c467e4 into f3c7b6ddba4fb335b7b80f9c108e93ef/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/043a8c598893443d8306b3041135d226_SeqId_46_ - updating store file list. 2023-11-28 14:54:19,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/043a8c598893443d8306b3041135d226_SeqId_46_ into f3c7b6ddba4fb335b7b80f9c108e93ef/family1 2023-11-28 14:54:19,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9p0oe3o8j0d5gkbqsde6tgts70o8inghjdhoj6i7f2ounaubhf77metbro66uhs3/family1/9faf6731fc63479a851ee9ce73c467e4 into f3c7b6ddba4fb335b7b80f9c108e93ef/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/043a8c598893443d8306b3041135d226_SeqId_46_) 2023-11-28 14:54:19,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyPolicy__9p0oe3o8j0d5gkbqsde6tgts70o8inghjdhoj6i7f2ounaubhf77metbro66uhs3/family1/9faf6731fc63479a851ee9ce73c467e4 2023-11-28 14:54:19,960 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:19,960 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:19,962 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130dc50d61ef2f840a2a52372dac3b34a3e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130dc50d61ef2f840a2a52372dac3b34a3e 2023-11-28 14:54:19,963 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013b70b8f9d0934957a50decf50660e29c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512013b70b8f9d0934957a50decf50660e29c 2023-11-28 14:54:19,964 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb5ffd09af2b4a77a0776734ea3a1d01 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb5ffd09af2b4a77a0776734ea3a1d01 2023-11-28 14:54:19,964 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-28 14:54:19,964 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-28 14:54:19,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-28 14:54:19,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-28 14:54:19,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:19,966 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:54:19,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4770 sec 2023-11-28 14:54:20,080 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=253 (was 257), OpenFileDescriptor=642 (was 641) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 241), ProcessCount=172 (was 172), AvailableMemoryMB=7676 (was 7731) 2023-11-28 14:54:20,093 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=253, OpenFileDescriptor=642, MaxFileDescriptor=60000, SystemLoadAverage=219, ProcessCount=172, AvailableMemoryMB=7675 2023-11-28 14:54:20,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-28 14:54:20,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:20,097 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:54:20,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-28 14:54:20,097 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:54:20,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-28 14:54:20,099 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344 2023-11-28 14:54:20,100 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344 empty. 2023-11-28 14:54:20,100 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344 2023-11-28 14:54:20,100 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-28 14:54:20,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-28 14:54:20,290 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/.tmp/family1/6a456fdaf7024f32a7d3739dad4834fa as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/6a456fdaf7024f32a7d3739dad4834fa 2023-11-28 14:54:20,295 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f3c7b6ddba4fb335b7b80f9c108e93ef/family1 of f3c7b6ddba4fb335b7b80f9c108e93ef into 6a456fdaf7024f32a7d3739dad4834fa(size=6.6 K), total size for store is 337.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:54:20,295 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:54:20,295 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1701183259425; duration=0sec 2023-11-28 14:54:20,295 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:20,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2cf6949f94724f2fb820827ea29842cd, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1c2c6b38c8b74521a8f1ffb45c8860d0, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/87291d8aa28b4927a8a5c6d6760cdd80, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/5e970f216adc44d8ba3dde4416f0309f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/33e61dda4eb040e2bf462553bfd589a2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/7e25a1d314e34501a18528824bacc80f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1ac52fde1a094211b2adcf1cb2ba4926, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/b8a375ea5df84fff895b8881841c645c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2a495760b35f4aff8b8e6f944aafd14f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/3142d7fab32941b89ca2d778458ac135_SeqId_44_] to archive 2023-11-28 14:54:20,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:20,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2cf6949f94724f2fb820827ea29842cd to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2cf6949f94724f2fb820827ea29842cd 2023-11-28 14:54:20,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1c2c6b38c8b74521a8f1ffb45c8860d0 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1c2c6b38c8b74521a8f1ffb45c8860d0 2023-11-28 14:54:20,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/87291d8aa28b4927a8a5c6d6760cdd80 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/87291d8aa28b4927a8a5c6d6760cdd80 2023-11-28 14:54:20,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/5e970f216adc44d8ba3dde4416f0309f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/5e970f216adc44d8ba3dde4416f0309f 2023-11-28 14:54:20,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/33e61dda4eb040e2bf462553bfd589a2 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/33e61dda4eb040e2bf462553bfd589a2 2023-11-28 14:54:20,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/7e25a1d314e34501a18528824bacc80f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/7e25a1d314e34501a18528824bacc80f 2023-11-28 14:54:20,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1ac52fde1a094211b2adcf1cb2ba4926 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/1ac52fde1a094211b2adcf1cb2ba4926 2023-11-28 14:54:20,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/b8a375ea5df84fff895b8881841c645c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/b8a375ea5df84fff895b8881841c645c 2023-11-28 14:54:20,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2a495760b35f4aff8b8e6f944aafd14f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/2a495760b35f4aff8b8e6f944aafd14f 2023-11-28 14:54:20,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/3142d7fab32941b89ca2d778458ac135_SeqId_44_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/family1/3142d7fab32941b89ca2d778458ac135_SeqId_44_ 2023-11-28 14:54:20,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-28 14:54:20,510 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-28 14:54:20,511 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => c28198633832a22507986a5565e93344, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:20,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-28 14:54:20,917 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:20,917 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing c28198633832a22507986a5565e93344, disabling compactions & flushes 2023-11-28 14:54:20,917 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:20,917 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:20,917 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. after waiting 0 ms 2023-11-28 14:54:20,917 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:20,918 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:20,918 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:20,920 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:54:20,921 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183260921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183260921"}]},"ts":"1701183260921"} 2023-11-28 14:54:20,922 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-28 14:54:20,923 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:54:20,923 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183260923"}]},"ts":"1701183260923"} 2023-11-28 14:54:20,924 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-28 14:54:20,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, ASSIGN}] 2023-11-28 14:54:20,930 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, ASSIGN 2023-11-28 14:54:20,930 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:21,081 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:21,082 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183261081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183261081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183261081"}]},"ts":"1701183261081"} 2023-11-28 14:54:21,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:21,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-28 14:54:21,235 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:21,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:21,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c28198633832a22507986a5565e93344, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:54:21,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly c28198633832a22507986a5565e93344 2023-11-28 14:54:21,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:21,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c28198633832a22507986a5565e93344 2023-11-28 14:54:21,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c28198633832a22507986a5565e93344 2023-11-28 14:54:21,240 INFO [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c28198633832a22507986a5565e93344 2023-11-28 14:54:21,241 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:21,241 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:21,242 INFO [StoreOpener-c28198633832a22507986a5565e93344-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c28198633832a22507986a5565e93344 columnFamilyName family1 2023-11-28 14:54:21,243 INFO [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(310): Store=c28198633832a22507986a5565e93344/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:21,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344 2023-11-28 14:54:21,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344 2023-11-28 14:54:21,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c28198633832a22507986a5565e93344 2023-11-28 14:54:21,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:21,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c28198633832a22507986a5565e93344; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60728883, jitterRate=-0.09506912529468536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:54:21,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:21,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344., pid=41, masterSystemTime=1701183261235 2023-11-28 14:54:21,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:21,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:21,251 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:21,251 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183261251"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183261251"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183261251"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183261251"}]},"ts":"1701183261251"} 2023-11-28 14:54:21,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=41, resume processing ppid=40 2023-11-28 14:54:21,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531 in 170 msec 2023-11-28 14:54:21,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=40, resume processing ppid=39 2023-11-28 14:54:21,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, ASSIGN in 326 msec 2023-11-28 14:54:21,256 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:54:21,256 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183261256"}]},"ts":"1701183261256"} 2023-11-28 14:54:21,257 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-28 14:54:21,260 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:54:21,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1650 sec 2023-11-28 14:54:22,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-28 14:54:22,204 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-28 14:54:22,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:22,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,227 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:22,227 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:22,227 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:22,227 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:22,228 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,228 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,229 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:22,229 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:22,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:22,230 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,230 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:22,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,232 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,232 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:22,232 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:22,232 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:22,232 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:22,232 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:22,232 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:22,232 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:22,233 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-28 14:54:22,252 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304394f7d5e1ad4d088b698a89ceba3716 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511304394f7d5e1ad4d088b698a89ceba3716 2023-11-28 14:54:22,255 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/718dea50f7094fbb87fdeeef988d0fbb 2023-11-28 14:54:22,260 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/718dea50f7094fbb87fdeeef988d0fbb as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/718dea50f7094fbb87fdeeef988d0fbb 2023-11-28 14:54:22,265 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/718dea50f7094fbb87fdeeef988d0fbb, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-28 14:54:22,266 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 33ms, sequenceid=5, compaction requested=false 2023-11-28 14:54:22,266 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:22,267 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:22,267 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:22,267 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:22,267 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:22,267 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,267 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:22,267 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:22,269 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,269 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:22,269 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,269 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:22,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:22,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:22,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e227f66[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:22,271 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:22,271 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,276 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:22,277 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:22,277 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,277 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:22,278 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:22,278 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:22,278 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,278 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:22,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:22,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:22,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:22,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:22,281 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:22,281 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:22,281 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:22,281 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,281 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:22,282 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,282 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,282 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:22,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:22,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:22,283 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,284 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,287 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,288 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:22,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:22,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:22,288 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:22,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:22,388 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:22,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:22,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:22,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:22,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,395 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:22,395 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:22,395 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:22,395 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:22,396 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,396 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,398 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,398 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:22,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:22,398 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:22,398 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,399 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,400 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-28 14:54:22,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:22,400 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:22,400 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:22,400 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:22,400 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:22,400 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:22,400 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:22,400 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:22,400 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-28 14:54:22,817 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ff9fcaaffb304425be73dc651788e6a7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128ff9fcaaffb304425be73dc651788e6a7 2023-11-28 14:54:23,225 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/1b3a4b0ed187459dbf0d6dace28b4bf2 2023-11-28 14:54:23,230 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/1b3a4b0ed187459dbf0d6dace28b4bf2 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/1b3a4b0ed187459dbf0d6dace28b4bf2 2023-11-28 14:54:23,233 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/1b3a4b0ed187459dbf0d6dace28b4bf2, entries=1, sequenceid=9, filesize=5.0 K 2023-11-28 14:54:23,234 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 834ms, sequenceid=9, compaction requested=false 2023-11-28 14:54:23,234 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:23,234 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:23,236 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,236 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:23,237 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,237 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:23,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:23,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:23,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:23,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:23,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7110d07b[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:23,238 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:23,238 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,239 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,240 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:23,240 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:23,240 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:23,240 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,240 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:23,241 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:23,241 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:23,241 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,241 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:23,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:23,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:23,244 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:23,244 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:23,244 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:23,244 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,244 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:23,246 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,246 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,246 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:23,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:23,247 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:23,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,248 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:23,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,253 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,253 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:23,253 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:23,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:23,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:23,253 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:23,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:23,253 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:23,254 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,254 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,254 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,254 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,254 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:23,254 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:23,254 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:23,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:23,354 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:23,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:23,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:23,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:23,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,361 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:23,361 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:23,361 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:23,361 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:23,361 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,361 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,363 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:23,363 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:23,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:23,363 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:23,363 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:23,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:23,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,364 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,364 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-28 14:54:23,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:23,365 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:23,365 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:23,365 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:23,365 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:23,365 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:23,365 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:23,365 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:23,365 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:23,777 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017a8ccca629684b33b7f916324f8dbe38 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512017a8ccca629684b33b7f916324f8dbe38 2023-11-28 14:54:24,183 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/75f98313c9b44abc8f771e50e125a0e7 2023-11-28 14:54:24,189 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/75f98313c9b44abc8f771e50e125a0e7 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/75f98313c9b44abc8f771e50e125a0e7 2023-11-28 14:54:24,193 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/75f98313c9b44abc8f771e50e125a0e7, entries=1, sequenceid=13, filesize=5.0 K 2023-11-28 14:54:24,194 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 829ms, sequenceid=13, compaction requested=true 2023-11-28 14:54:24,194 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:24,194 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:24,194 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:24,194 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:24,194 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,194 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:24,194 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:24,197 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:24,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b78fafb[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:24,199 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:24,199 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,200 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,200 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:24,200 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:24,200 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:24,200 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,200 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:24,202 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,202 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:24,202 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:24,202 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:24,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:24,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:24,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:24,204 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:24,205 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:24,205 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:24,205 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,205 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:24,206 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,206 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:24,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:24,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,206 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:24,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:24,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:24,207 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,208 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:24,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,211 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:24,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:24,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:24,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:24,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:24,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-28 14:54:24,211 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:24,212 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:24,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:24,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:24,312 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:24,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:24,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:24,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:24,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,318 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:24,318 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:24,318 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:24,318 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:24,318 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,318 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,320 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:24,320 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:24,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:24,320 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:24,320 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:24,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:24,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,321 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,321 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-28 14:54:24,321 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:24,321 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:24,321 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:24,321 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:24,322 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:24,322 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:24,322 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:24,322 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:24,322 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:24,734 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cc1c9400f9d646a2a603b8ff66493f03 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205cc1c9400f9d646a2a603b8ff66493f03 2023-11-28 14:54:25,140 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/14e02d6eb3c64651b6e41ce290bac105 2023-11-28 14:54:25,146 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/14e02d6eb3c64651b6e41ce290bac105 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/14e02d6eb3c64651b6e41ce290bac105 2023-11-28 14:54:25,150 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/14e02d6eb3c64651b6e41ce290bac105, entries=1, sequenceid=17, filesize=5.0 K 2023-11-28 14:54:25,151 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 829ms, sequenceid=17, compaction requested=true 2023-11-28 14:54:25,151 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:25,151 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:25,151 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:25,151 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:25,151 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,151 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:25,151 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:25,153 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,153 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:25,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:25,154 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:25,154 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:25,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:25,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:25,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ab36e39[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:25,155 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:25,155 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,157 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,157 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:25,157 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:25,157 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:25,157 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,157 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:25,160 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:25,160 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:25,160 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,160 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:25,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:25,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:25,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:25,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:25,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:25,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:25,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:25,163 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:25,163 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:25,163 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:25,163 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,163 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:25,165 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,165 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,165 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:25,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,166 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,167 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,169 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,169 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,169 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,170 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,170 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,170 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:25,170 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:25,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:25,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-28 14:54:25,170 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:25,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:25,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:25,170 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:25,170 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,170 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:25,170 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:25,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:25,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:25,270 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:25,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:25,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:25,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:25,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,277 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:25,277 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:25,277 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:25,277 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:25,277 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,277 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,282 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,282 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:25,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:25,283 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:25,283 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,283 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,284 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-28 14:54:25,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:25,284 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:25,284 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:25,284 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:25,698 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512287d927eb9c652443ea6dbd551978ff36f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512287d927eb9c652443ea6dbd551978ff36f 2023-11-28 14:54:26,104 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/9e872d7a6b3d4e7093f56b78acac40bb 2023-11-28 14:54:26,109 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/9e872d7a6b3d4e7093f56b78acac40bb as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9e872d7a6b3d4e7093f56b78acac40bb 2023-11-28 14:54:26,114 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9e872d7a6b3d4e7093f56b78acac40bb, entries=1, sequenceid=21, filesize=5.0 K 2023-11-28 14:54:26,115 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 831ms, sequenceid=21, compaction requested=true 2023-11-28 14:54:26,115 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:26,115 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:26,115 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:26,115 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:26,116 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,116 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:26,116 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:26,117 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,117 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:26,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:26,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:26,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c7fd46[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:26,119 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:26,120 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,122 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,122 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:26,122 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:26,122 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,122 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:26,122 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:26,125 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,125 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:26,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:26,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:26,125 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:26,125 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:26,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:26,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:26,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:26,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:26,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:26,127 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:26,128 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:26,128 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:26,128 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,128 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:26,129 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,129 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:26,129 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:26,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:26,130 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:26,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,132 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:26,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:26,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:26,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-28 14:54:26,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:26,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:26,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:26,135 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,135 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:26,135 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,135 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,135 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,135 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,135 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:26,135 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:26,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:26,235 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:26,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:26,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:26,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:26,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,243 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:26,243 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:26,243 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:26,243 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:26,243 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,243 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,245 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,245 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:26,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:26,246 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:26,246 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,247 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,247 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-28 14:54:26,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:26,247 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:26,247 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:26,247 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:26,247 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:26,247 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:26,247 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:26,247 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:26,248 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:26,661 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231501809895856443e922d3df279d31f74 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231501809895856443e922d3df279d31f74 2023-11-28 14:54:26,770 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:54:27,067 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/23f6076da33a4ca7b5c0d13321faac05 2023-11-28 14:54:27,072 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/23f6076da33a4ca7b5c0d13321faac05 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/23f6076da33a4ca7b5c0d13321faac05 2023-11-28 14:54:27,077 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/23f6076da33a4ca7b5c0d13321faac05, entries=1, sequenceid=25, filesize=5.0 K 2023-11-28 14:54:27,078 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 830ms, sequenceid=25, compaction requested=true 2023-11-28 14:54:27,078 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:27,078 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:27,078 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:27,078 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:27,078 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,078 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:27,078 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:27,080 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,080 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:27,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:27,080 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,080 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:27,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:27,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@702376cd[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:27,082 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:27,082 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,083 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,083 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:27,083 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:27,083 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,083 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:27,083 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:27,084 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,084 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:27,084 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,084 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:27,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:27,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:27,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:27,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:27,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:27,087 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:27,087 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:27,087 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:27,087 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,087 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:27,089 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,089 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:27,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,090 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:27,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:27,090 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,091 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:27,094 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:27,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-28 14:54:27,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:27,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:27,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:27,094 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:27,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:27,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:27,194 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:27,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:27,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:27,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:27,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,201 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:27,201 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:27,201 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:27,201 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:27,201 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,202 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,203 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,203 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:27,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:27,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:27,203 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,203 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:27,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-28 14:54:27,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,205 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:27,205 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:27,205 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:27,205 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:27,205 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:27,205 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:27,205 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:27,205 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:27,618 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010876d89dec1b4320910ae7940c3c0c22 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601010876d89dec1b4320910ae7940c3c0c22 2023-11-28 14:54:27,623 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/274c1ab9374a45519103590e1f376b20 2023-11-28 14:54:27,629 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/274c1ab9374a45519103590e1f376b20 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/274c1ab9374a45519103590e1f376b20 2023-11-28 14:54:27,633 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/274c1ab9374a45519103590e1f376b20, entries=1, sequenceid=29, filesize=5.0 K 2023-11-28 14:54:27,634 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 429ms, sequenceid=29, compaction requested=true 2023-11-28 14:54:27,634 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:27,634 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:27,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:27,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:27,634 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,635 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:27,635 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:27,636 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,636 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:27,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:27,637 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,637 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:27,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:27,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:27,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:27,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:27,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c30e510[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:27,638 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:27,638 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,641 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,641 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:27,641 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:27,641 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:27,641 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,641 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:27,646 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:27,646 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:27,646 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,646 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:27,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:27,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:27,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:27,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:27,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:27,648 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:27,648 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:27,648 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:27,648 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,648 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:27,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:27,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:27,650 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:27,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,652 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:27,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,654 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,654 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:27,654 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:27,654 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:27,654 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:27,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:27,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:27,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:27,654 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,655 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,655 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,655 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,655 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,655 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:27,655 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:27,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:27,755 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:27,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:27,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:27,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:27,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,762 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:27,762 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:27,762 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:27,762 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:27,762 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,762 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,764 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,764 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:27,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:27,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:27,765 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:27,765 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:27,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,766 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-28 14:54:27,766 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:27,766 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:27,766 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:27,766 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:27,766 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:27,766 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:27,766 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:27,766 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:27,766 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:28,179 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d871ce9c0aa2458a9ec5917709df7d2b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d871ce9c0aa2458a9ec5917709df7d2b 2023-11-28 14:54:28,584 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/a8df82de1ca149b6a30c96609ca5d56d 2023-11-28 14:54:28,589 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/a8df82de1ca149b6a30c96609ca5d56d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/a8df82de1ca149b6a30c96609ca5d56d 2023-11-28 14:54:28,593 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/a8df82de1ca149b6a30c96609ca5d56d, entries=1, sequenceid=33, filesize=5.0 K 2023-11-28 14:54:28,594 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 828ms, sequenceid=33, compaction requested=true 2023-11-28 14:54:28,594 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:28,594 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:28,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:28,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:28,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:28,594 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:28,596 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,596 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:28,596 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,596 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:28,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:28,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:28,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:28,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:28,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d438809[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:28,598 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:28,598 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,599 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:28,599 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,599 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:28,600 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:28,600 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:28,600 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,600 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:28,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:28,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:28,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:28,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:28,603 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:28,603 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:28,603 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:28,603 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,603 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:28,605 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,605 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,605 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:28,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:28,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:28,606 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,607 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,609 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,609 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,609 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:28,610 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:28,610 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:28,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:28,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:28,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-28 14:54:28,610 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:28,610 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,610 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,610 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:28,610 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:28,610 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:28,610 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:28,710 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:28,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:28,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:28,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:28,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,717 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:28,717 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:28,717 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:28,717 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:28,717 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,717 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,719 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,719 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:28,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:28,719 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:28,719 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,720 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,720 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-28 14:54:28,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:28,720 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:28,720 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:28,720 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:28,720 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:28,720 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:28,720 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:28,720 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:28,720 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:29,137 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b1d29a1b52a249f08d81e2424dd5ab93 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907b1d29a1b52a249f08d81e2424dd5ab93 2023-11-28 14:54:29,144 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/63429cdeba4f4b5f98f27190151a68a7 2023-11-28 14:54:29,148 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/63429cdeba4f4b5f98f27190151a68a7 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/63429cdeba4f4b5f98f27190151a68a7 2023-11-28 14:54:29,151 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/63429cdeba4f4b5f98f27190151a68a7, entries=1, sequenceid=37, filesize=5.0 K 2023-11-28 14:54:29,152 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 432ms, sequenceid=37, compaction requested=true 2023-11-28 14:54:29,152 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:29,152 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:29,153 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:29,153 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:29,153 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,153 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:29,153 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:29,155 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,155 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:29,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:29,155 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,155 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:29,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:29,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:29,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45d6772a[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:29,157 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:29,157 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,159 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,160 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:29,160 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:29,160 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:29,160 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,160 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:29,161 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:29,161 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,161 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:29,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:29,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:29,161 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:29,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:29,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:29,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:29,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:29,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:29,165 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:29,165 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:29,165 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:29,165 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,165 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:29,167 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,167 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,167 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:29,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:29,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:29,168 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:29,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:29,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:29,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:29,169 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:29,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:29,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:29,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:29,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:29,175 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:29,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,175 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:29,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:29,176 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:29,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:29,276 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:29,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:29,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:29,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:29,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,283 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:29,283 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:29,283 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-28 14:54:29,283 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-28 14:54:29,283 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,283 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,285 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,285 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:29,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:29,285 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:29,285 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,286 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,286 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-28 14:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-28 14:54:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-28 14:54:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:29,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:29,287 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:29,287 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. started... 2023-11-28 14:54:29,287 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c28198633832a22507986a5565e93344 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:29,701 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511209128983814204346b74b46643d125b6b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511209128983814204346b74b46643d125b6b 2023-11-28 14:54:30,107 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/64be4a90e17d4baca16698bf0eec36fd 2023-11-28 14:54:30,111 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/64be4a90e17d4baca16698bf0eec36fd as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/64be4a90e17d4baca16698bf0eec36fd 2023-11-28 14:54:30,115 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/64be4a90e17d4baca16698bf0eec36fd, entries=1, sequenceid=41, filesize=5.0 K 2023-11-28 14:54:30,116 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c28198633832a22507986a5565e93344 in 829ms, sequenceid=41, compaction requested=true 2023-11-28 14:54:30,116 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:30,116 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-28 14:54:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-28 14:54:30,118 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:30,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:30,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-28 14:54:30,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ea8f443[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:30,120 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-28 14:54:30,120 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,122 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,122 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-28 14:54:30,122 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-28 14:54:30,122 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:30,123 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,123 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:30,124 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,124 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-28 14:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:30,124 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:30,124 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-28 14:54:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:30,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-28 14:54:30,126 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-28 14:54:30,127 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:30,127 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:30,127 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,127 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:30,129 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,129 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:30,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,129 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:30,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,129 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,131 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,133 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,133 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,133 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,133 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:30,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,134 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:30,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-28 14:54:30,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:30,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:30,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:30,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:30,134 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:30,134 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:30,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:30,234 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:30,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:30,236 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:30,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-28 14:54:30,238 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-28 14:54:30,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:30,239 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183870239 2023-11-28 14:54:30,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:54:30,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-28 14:54:30,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:30,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x5f541d05 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:30,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@177a3f6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:30,248 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,685 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103689910baf3cb4ec9919084baf4f72061 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103689910baf3cb4ec9919084baf4f72061 2023-11-28 14:54:30,686 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:30,705 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:54:30,706 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:54:30,713 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:54:30,714 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:54:30,724 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/56b85f76bd4d4bae97091cee6ec0af3c first=Optional[r3] last=Optional[r6] 2023-11-28 14:54:30,724 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/56b85f76bd4d4bae97091cee6ec0af3c}] 2023-11-28 14:54:30,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/56b85f76bd4d4bae97091cee6ec0af3c for inclusion in c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:30,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-28 14:54:30,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:30,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:30,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/56b85f76bd4d4bae97091cee6ec0af3c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eu6vkeu4pe0s03rf1hj6a6i3rkho2p1n01vlhdtuoln5ko029ljl760u05pmenk9/family1/56b85f76bd4d4bae97091cee6ec0af3c 2023-11-28 14:54:30,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eu6vkeu4pe0s03rf1hj6a6i3rkho2p1n01vlhdtuoln5ko029ljl760u05pmenk9/family1/56b85f76bd4d4bae97091cee6ec0af3c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9ec33db147d648a084f065c3e50a51b2_SeqId_44_ 2023-11-28 14:54:30,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eu6vkeu4pe0s03rf1hj6a6i3rkho2p1n01vlhdtuoln5ko029ljl760u05pmenk9/family1/56b85f76bd4d4bae97091cee6ec0af3c into c28198633832a22507986a5565e93344/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9ec33db147d648a084f065c3e50a51b2_SeqId_44_ - updating store file list. 2023-11-28 14:54:30,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9ec33db147d648a084f065c3e50a51b2_SeqId_44_ into c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:30,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eu6vkeu4pe0s03rf1hj6a6i3rkho2p1n01vlhdtuoln5ko029ljl760u05pmenk9/family1/56b85f76bd4d4bae97091cee6ec0af3c into c28198633832a22507986a5565e93344/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9ec33db147d648a084f065c3e50a51b2_SeqId_44_) 2023-11-28 14:54:30,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__eu6vkeu4pe0s03rf1hj6a6i3rkho2p1n01vlhdtuoln5ko029ljl760u05pmenk9/family1/56b85f76bd4d4bae97091cee6ec0af3c 2023-11-28 14:54:30,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-28 14:54:30,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-28 14:54:30,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): c28198633832a22507986a5565e93344/family1 is initiating minor compaction 2023-11-28 14:54:30,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@140aba82; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:30,741 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c28198633832a22507986a5565e93344/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:30,741 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/1b3a4b0ed187459dbf0d6dace28b4bf2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/75f98313c9b44abc8f771e50e125a0e7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/14e02d6eb3c64651b6e41ce290bac105, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9e872d7a6b3d4e7093f56b78acac40bb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/23f6076da33a4ca7b5c0d13321faac05, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/274c1ab9374a45519103590e1f376b20, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/a8df82de1ca149b6a30c96609ca5d56d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/63429cdeba4f4b5f98f27190151a68a7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/64be4a90e17d4baca16698bf0eec36fd, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9ec33db147d648a084f065c3e50a51b2_SeqId_44_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp, totalSize=50.4 K 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 1b3a4b0ed187459dbf0d6dace28b4bf2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 75f98313c9b44abc8f771e50e125a0e7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 14e02d6eb3c64651b6e41ce290bac105, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 9e872d7a6b3d4e7093f56b78acac40bb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 23f6076da33a4ca7b5c0d13321faac05, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 274c1ab9374a45519103590e1f376b20, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting a8df82de1ca149b6a30c96609ca5d56d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 63429cdeba4f4b5f98f27190151a68a7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 64be4a90e17d4baca16698bf0eec36fd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-28 14:54:30,742 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 9ec33db147d648a084f065c3e50a51b2_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-28 14:54:30,744 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:30,745 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:30,747 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512287d927eb9c652443ea6dbd551978ff36f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512287d927eb9c652443ea6dbd551978ff36f 2023-11-28 14:54:30,748 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231501809895856443e922d3df279d31f74 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231501809895856443e922d3df279d31f74 2023-11-28 14:54:30,750 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601010876d89dec1b4320910ae7940c3c0c22 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601010876d89dec1b4320910ae7940c3c0c22 2023-11-28 14:54:30,751 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d871ce9c0aa2458a9ec5917709df7d2b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d871ce9c0aa2458a9ec5917709df7d2b 2023-11-28 14:54:30,751 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-28 14:54:30,751 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-28 14:54:30,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,770 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): c28198633832a22507986a5565e93344#family1#compaction#59 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:54:30,804 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cef0bbe7e5b84b24b1b9829191e1d672 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205cef0bbe7e5b84b24b1b9829191e1d672 2023-11-28 14:54:30,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:30,829 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/99cf121a069f4e78bcad83b68595fa81 first=Optional[r00] last=Optional[r2] 2023-11-28 14:54:30,829 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/99cf121a069f4e78bcad83b68595fa81}] 2023-11-28 14:54:30,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/99cf121a069f4e78bcad83b68595fa81 for inclusion in c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:30,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-28 14:54:30,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:30,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:30,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/99cf121a069f4e78bcad83b68595fa81 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2ujr46hqp4lg8vg5taa6d1csveraecfevon02b7pm6sncgou4emolc5o6moppr9k/family1/99cf121a069f4e78bcad83b68595fa81 2023-11-28 14:54:30,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2ujr46hqp4lg8vg5taa6d1csveraecfevon02b7pm6sncgou4emolc5o6moppr9k/family1/99cf121a069f4e78bcad83b68595fa81 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b4e309c756f341768c9124cbe76e45cb_SeqId_46_ 2023-11-28 14:54:30,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2ujr46hqp4lg8vg5taa6d1csveraecfevon02b7pm6sncgou4emolc5o6moppr9k/family1/99cf121a069f4e78bcad83b68595fa81 into c28198633832a22507986a5565e93344/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b4e309c756f341768c9124cbe76e45cb_SeqId_46_ - updating store file list. 2023-11-28 14:54:30,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b4e309c756f341768c9124cbe76e45cb_SeqId_46_ into c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:30,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2ujr46hqp4lg8vg5taa6d1csveraecfevon02b7pm6sncgou4emolc5o6moppr9k/family1/99cf121a069f4e78bcad83b68595fa81 into c28198633832a22507986a5565e93344/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b4e309c756f341768c9124cbe76e45cb_SeqId_46_) 2023-11-28 14:54:30,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2ujr46hqp4lg8vg5taa6d1csveraecfevon02b7pm6sncgou4emolc5o6moppr9k/family1/99cf121a069f4e78bcad83b68595fa81 2023-11-28 14:54:30,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:30,845 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:30,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511304394f7d5e1ad4d088b698a89ceba3716 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511304394f7d5e1ad4d088b698a89ceba3716 2023-11-28 14:54:30,848 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512017a8ccca629684b33b7f916324f8dbe38 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512017a8ccca629684b33b7f916324f8dbe38 2023-11-28 14:54:30,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205cc1c9400f9d646a2a603b8ff66493f03 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205cc1c9400f9d646a2a603b8ff66493f03 2023-11-28 14:54:30,849 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-28 14:54:30,849 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-28 14:54:30,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:30,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:30,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:30,851 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-28 14:54:30,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 614 msec 2023-11-28 14:54:30,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-28 14:54:30,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:31,358 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-28 14:54:31,359 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-28 14:54:31,359 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-28 14:54:31,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-28 14:54:31,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, REOPEN/MOVE}] 2023-11-28 14:54:31,364 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, REOPEN/MOVE 2023-11-28 14:54:31,365 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:31,365 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183271365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183271365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183271365"}]},"ts":"1701183271365"} 2023-11-28 14:54:31,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:31,518 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:31,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c28198633832a22507986a5565e93344 2023-11-28 14:54:31,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c28198633832a22507986a5565e93344, disabling compactions & flushes 2023-11-28 14:54:31,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:31,591 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/4396ad1134f54042b63315b9846bf8bd as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/4396ad1134f54042b63315b9846bf8bd 2023-11-28 14:54:31,596 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c28198633832a22507986a5565e93344/family1 of c28198633832a22507986a5565e93344 into 4396ad1134f54042b63315b9846bf8bd(size=6.8 K), total size for store is 390.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:54:31,596 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:31,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:31,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:31,596 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1701183270741; duration=0sec 2023-11-28 14:54:31,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. after waiting 0 ms 2023-11-28 14:54:31,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:31,596 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:31,613 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/1b3a4b0ed187459dbf0d6dace28b4bf2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/75f98313c9b44abc8f771e50e125a0e7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/14e02d6eb3c64651b6e41ce290bac105, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9e872d7a6b3d4e7093f56b78acac40bb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/23f6076da33a4ca7b5c0d13321faac05, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/274c1ab9374a45519103590e1f376b20, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/a8df82de1ca149b6a30c96609ca5d56d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/63429cdeba4f4b5f98f27190151a68a7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/64be4a90e17d4baca16698bf0eec36fd, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9ec33db147d648a084f065c3e50a51b2_SeqId_44_] to archive 2023-11-28 14:54:31,614 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:31,615 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/1b3a4b0ed187459dbf0d6dace28b4bf2 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/1b3a4b0ed187459dbf0d6dace28b4bf2 2023-11-28 14:54:31,617 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/75f98313c9b44abc8f771e50e125a0e7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/75f98313c9b44abc8f771e50e125a0e7 2023-11-28 14:54:31,618 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/14e02d6eb3c64651b6e41ce290bac105 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/14e02d6eb3c64651b6e41ce290bac105 2023-11-28 14:54:31,619 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9e872d7a6b3d4e7093f56b78acac40bb to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9e872d7a6b3d4e7093f56b78acac40bb 2023-11-28 14:54:31,620 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/23f6076da33a4ca7b5c0d13321faac05 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/23f6076da33a4ca7b5c0d13321faac05 2023-11-28 14:54:31,621 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/274c1ab9374a45519103590e1f376b20 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/274c1ab9374a45519103590e1f376b20 2023-11-28 14:54:31,622 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/a8df82de1ca149b6a30c96609ca5d56d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/a8df82de1ca149b6a30c96609ca5d56d 2023-11-28 14:54:31,623 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/63429cdeba4f4b5f98f27190151a68a7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/63429cdeba4f4b5f98f27190151a68a7 2023-11-28 14:54:31,624 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/64be4a90e17d4baca16698bf0eec36fd to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/64be4a90e17d4baca16698bf0eec36fd 2023-11-28 14:54:31,625 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9ec33db147d648a084f065c3e50a51b2_SeqId_44_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/9ec33db147d648a084f065c3e50a51b2_SeqId_44_ 2023-11-28 14:54:31,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-28 14:54:31,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:31,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:31,631 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: c28198633832a22507986a5565e93344 to self. 2023-11-28 14:54:31,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c28198633832a22507986a5565e93344 2023-11-28 14:54:31,632 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=CLOSED 2023-11-28 14:54:31,633 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183271632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183271632"}]},"ts":"1701183271632"} 2023-11-28 14:54:31,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=46, resume processing ppid=45 2023-11-28 14:54:31,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531 in 268 msec 2023-11-28 14:54:31,636 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=true 2023-11-28 14:54:31,786 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:31,786 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183271786"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183271786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183271786"}]},"ts":"1701183271786"} 2023-11-28 14:54:31,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:31,939 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:31,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:31,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c28198633832a22507986a5565e93344, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:54:31,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly c28198633832a22507986a5565e93344 2023-11-28 14:54:31,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:31,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c28198633832a22507986a5565e93344 2023-11-28 14:54:31,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c28198633832a22507986a5565e93344 2023-11-28 14:54:31,944 INFO [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c28198633832a22507986a5565e93344 2023-11-28 14:54:31,945 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:31,945 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:31,946 INFO [StoreOpener-c28198633832a22507986a5565e93344-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c28198633832a22507986a5565e93344 columnFamilyName family1 2023-11-28 14:54:31,951 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/4396ad1134f54042b63315b9846bf8bd 2023-11-28 14:54:31,955 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/718dea50f7094fbb87fdeeef988d0fbb 2023-11-28 14:54:31,958 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b4e309c756f341768c9124cbe76e45cb_SeqId_46_ 2023-11-28 14:54:31,958 INFO [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(310): Store=c28198633832a22507986a5565e93344/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:31,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344 2023-11-28 14:54:31,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344 2023-11-28 14:54:31,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c28198633832a22507986a5565e93344 2023-11-28 14:54:31,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c28198633832a22507986a5565e93344; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71656314, jitterRate=0.06776228547096252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:54:31,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:31,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344., pid=47, masterSystemTime=1701183271939 2023-11-28 14:54:31,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:31,964 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-28 14:54:31,965 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-28 14:54:31,965 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1912): c28198633832a22507986a5565e93344/family1 is initiating minor compaction (all files) 2023-11-28 14:54:31,966 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c28198633832a22507986a5565e93344/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:31,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:31,966 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/718dea50f7094fbb87fdeeef988d0fbb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/4396ad1134f54042b63315b9846bf8bd, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b4e309c756f341768c9124cbe76e45cb_SeqId_46_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp, totalSize=390.1 K 2023-11-28 14:54:31,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:31,966 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 718dea50f7094fbb87fdeeef988d0fbb, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824829 2023-11-28 14:54:31,966 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:31,966 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183271966"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183271966"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183271966"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183271966"}]},"ts":"1701183271966"} 2023-11-28 14:54:31,967 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 4396ad1134f54042b63315b9846bf8bd, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224829 2023-11-28 14:54:31,967 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting b4e309c756f341768c9124cbe76e45cb_SeqId_46_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878824829 2023-11-28 14:54:31,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=47, resume processing ppid=45 2023-11-28 14:54:31,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531 in 180 msec 2023-11-28 14:54:31,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=45, resume processing ppid=44 2023-11-28 14:54:31,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, REOPEN/MOVE in 605 msec 2023-11-28 14:54:31,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=44, resume processing ppid=43 2023-11-28 14:54:31,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 611 msec 2023-11-28 14:54:31,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0280 sec 2023-11-28 14:54:31,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-28 14:54:31,978 INFO [Listener at localhost/45519] compactions.TestMobCompactor(278): alter status finished 2023-11-28 14:54:31,979 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:31,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-28 14:54:31,982 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): c28198633832a22507986a5565e93344#family1#compaction#60 average throughput is 20.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:54:31,985 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-28 14:54:31,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:31,986 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183871986 2023-11-28 14:54:31,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:54:31,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-28 14:54:31,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:31,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x7a1b2bdc to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:31,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c5cd293, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:31,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:31,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:31,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:31,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:31,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:32,824 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112848b0fab35c024d379aa9b4b81c0f3d29 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112848b0fab35c024d379aa9b4b81c0f3d29 2023-11-28 14:54:32,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:32,840 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:54:32,842 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:54:32,848 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:54:32,850 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:54:32,859 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3096de17c44478881e0a5ef51aae9e6 first=Optional[r05] last=Optional[r8] 2023-11-28 14:54:32,859 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=50 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3096de17c44478881e0a5ef51aae9e6}] 2023-11-28 14:54:32,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3096de17c44478881e0a5ef51aae9e6 for inclusion in c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:32,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-28 14:54:32,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:32,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:32,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3096de17c44478881e0a5ef51aae9e6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__larhn74p9t44g2rcth47ah74f5556p707gru49b08v3efhf3f6fj68u5hg9ojahp/family1/d3096de17c44478881e0a5ef51aae9e6 2023-11-28 14:54:32,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__larhn74p9t44g2rcth47ah74f5556p707gru49b08v3efhf3f6fj68u5hg9ojahp/family1/d3096de17c44478881e0a5ef51aae9e6 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/e686122357c4422293a07377ab33c595_SeqId_52_ 2023-11-28 14:54:32,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__larhn74p9t44g2rcth47ah74f5556p707gru49b08v3efhf3f6fj68u5hg9ojahp/family1/d3096de17c44478881e0a5ef51aae9e6 into c28198633832a22507986a5565e93344/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/e686122357c4422293a07377ab33c595_SeqId_52_ - updating store file list. 2023-11-28 14:54:32,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/e686122357c4422293a07377ab33c595_SeqId_52_ into c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:32,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__larhn74p9t44g2rcth47ah74f5556p707gru49b08v3efhf3f6fj68u5hg9ojahp/family1/d3096de17c44478881e0a5ef51aae9e6 into c28198633832a22507986a5565e93344/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/e686122357c4422293a07377ab33c595_SeqId_52_) 2023-11-28 14:54:32,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__larhn74p9t44g2rcth47ah74f5556p707gru49b08v3efhf3f6fj68u5hg9ojahp/family1/d3096de17c44478881e0a5ef51aae9e6 2023-11-28 14:54:32,875 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:32,876 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:32,877 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511209128983814204346b74b46643d125b6b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511209128983814204346b74b46643d125b6b 2023-11-28 14:54:32,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128ff9fcaaffb304425be73dc651788e6a7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128ff9fcaaffb304425be73dc651788e6a7 2023-11-28 14:54:32,878 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-28 14:54:32,878 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-28 14:54:32,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:32,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:32,879 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:32,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:32,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:32,880 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-28 14:54:32,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 900 msec 2023-11-28 14:54:32,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-28 14:54:32,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:33,204 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/.tmp/family1/b464d8a376a444f581c720d92584c747 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b464d8a376a444f581c720d92584c747 2023-11-28 14:54:33,209 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c28198633832a22507986a5565e93344/family1 of c28198633832a22507986a5565e93344 into b464d8a376a444f581c720d92584c747(size=193.0 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:54:33,209 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:33,209 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344., storeName=c28198633832a22507986a5565e93344/family1, priority=13, startTime=1701183271963; duration=1sec 2023-11-28 14:54:33,209 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:33,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/718dea50f7094fbb87fdeeef988d0fbb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/4396ad1134f54042b63315b9846bf8bd, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b4e309c756f341768c9124cbe76e45cb_SeqId_46_] to archive 2023-11-28 14:54:33,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:33,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/718dea50f7094fbb87fdeeef988d0fbb to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/718dea50f7094fbb87fdeeef988d0fbb 2023-11-28 14:54:33,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/4396ad1134f54042b63315b9846bf8bd to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/4396ad1134f54042b63315b9846bf8bd 2023-11-28 14:54:33,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b4e309c756f341768c9124cbe76e45cb_SeqId_46_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b4e309c756f341768c9124cbe76e45cb_SeqId_46_ 2023-11-28 14:54:33,348 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-28 14:54:33,350 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-28 14:54:33,350 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-28 14:54:33,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-28 14:54:33,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, REOPEN/MOVE}] 2023-11-28 14:54:33,356 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, REOPEN/MOVE 2023-11-28 14:54:33,356 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:33,357 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183273356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183273356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183273356"}]},"ts":"1701183273356"} 2023-11-28 14:54:33,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:33,510 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:33,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c28198633832a22507986a5565e93344 2023-11-28 14:54:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c28198633832a22507986a5565e93344, disabling compactions & flushes 2023-11-28 14:54:33,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. after waiting 0 ms 2023-11-28 14:54:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:33,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-28 14:54:33,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:33,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:33,518 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: c28198633832a22507986a5565e93344 to self. 2023-11-28 14:54:33,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c28198633832a22507986a5565e93344 2023-11-28 14:54:33,520 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=CLOSED 2023-11-28 14:54:33,520 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183273520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183273520"}]},"ts":"1701183273520"} 2023-11-28 14:54:33,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=52, resume processing ppid=51 2023-11-28 14:54:33,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531 in 163 msec 2023-11-28 14:54:33,523 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=true 2023-11-28 14:54:33,674 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:33,674 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183273674"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183273674"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183273674"}]},"ts":"1701183273674"} 2023-11-28 14:54:33,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:33,828 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:33,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:33,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c28198633832a22507986a5565e93344, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:54:33,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly c28198633832a22507986a5565e93344 2023-11-28 14:54:33,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:33,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c28198633832a22507986a5565e93344 2023-11-28 14:54:33,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c28198633832a22507986a5565e93344 2023-11-28 14:54:33,832 INFO [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c28198633832a22507986a5565e93344 2023-11-28 14:54:33,833 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:33,833 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1 2023-11-28 14:54:33,834 INFO [StoreOpener-c28198633832a22507986a5565e93344-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c28198633832a22507986a5565e93344 columnFamilyName family1 2023-11-28 14:54:33,839 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/b464d8a376a444f581c720d92584c747 2023-11-28 14:54:33,843 DEBUG [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/family1/e686122357c4422293a07377ab33c595_SeqId_52_ 2023-11-28 14:54:33,843 INFO [StoreOpener-c28198633832a22507986a5565e93344-1] regionserver.HStore(310): Store=c28198633832a22507986a5565e93344/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:33,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344 2023-11-28 14:54:33,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344 2023-11-28 14:54:33,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c28198633832a22507986a5565e93344 2023-11-28 14:54:33,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c28198633832a22507986a5565e93344; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67119901, jitterRate=1.6446411609649658E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:54:33,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c28198633832a22507986a5565e93344: 2023-11-28 14:54:33,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344., pid=53, masterSystemTime=1701183273828 2023-11-28 14:54:33,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:33,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:54:33,852 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=c28198633832a22507986a5565e93344, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:33,852 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701183273852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183273852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183273852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183273852"}]},"ts":"1701183273852"} 2023-11-28 14:54:33,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=53, resume processing ppid=51 2023-11-28 14:54:33,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure c28198633832a22507986a5565e93344, server=jenkins-hbase4.apache.org,41403,1701183201531 in 177 msec 2023-11-28 14:54:33,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=51, resume processing ppid=50 2023-11-28 14:54:33,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=c28198633832a22507986a5565e93344, REOPEN/MOVE in 500 msec 2023-11-28 14:54:33,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=50, resume processing ppid=49 2023-11-28 14:54:33,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 505 msec 2023-11-28 14:54:33,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 920 msec 2023-11-28 14:54:33,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-28 14:54:33,863 INFO [Listener at localhost/45519] compactions.TestMobCompactor(278): alter status finished 2023-11-28 14:54:33,864 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-28 14:54:33,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-28 14:54:33,866 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-28 14:54:33,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:33,866 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183873866 2023-11-28 14:54:33,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:54:33,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-28 14:54:33,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:33,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x38cce73d to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:33,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62de72fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:33,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:33,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:33,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:33,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:33,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:33,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:33,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:33,876 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-28 14:54:33,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-28 14:54:33,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:33,877 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-28 14:54:33,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 13 msec 2023-11-28 14:54:33,942 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=246 (was 253), OpenFileDescriptor=652 (was 642) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 219), ProcessCount=172 (was 172), AvailableMemoryMB=7671 (was 7675) 2023-11-28 14:54:33,957 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=246, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=193, ProcessCount=172, AvailableMemoryMB=7671 2023-11-28 14:54:33,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-28 14:54:33,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:33,961 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:54:33,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-28 14:54:33,962 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:54:33,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-28 14:54:33,964 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:33,965 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421 empty. 2023-11-28 14:54:33,965 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:33,965 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-28 14:54:34,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-28 14:54:34,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-28 14:54:34,374 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-28 14:54:34,375 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => f28c888789b361292b656b9a5c9a6421, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:34,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-28 14:54:34,782 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:34,782 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing f28c888789b361292b656b9a5c9a6421, disabling compactions & flushes 2023-11-28 14:54:34,782 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:34,782 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:34,782 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. after waiting 0 ms 2023-11-28 14:54:34,782 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:34,782 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:34,782 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:34,785 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:54:34,787 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183274786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183274786"}]},"ts":"1701183274786"} 2023-11-28 14:54:34,788 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-28 14:54:34,789 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:54:34,789 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183274789"}]},"ts":"1701183274789"} 2023-11-28 14:54:34,790 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-28 14:54:34,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, ASSIGN}] 2023-11-28 14:54:34,796 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, ASSIGN 2023-11-28 14:54:34,797 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:34,948 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:34,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183274948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183274948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183274948"}]},"ts":"1701183274948"} 2023-11-28 14:54:34,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:35,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-28 14:54:35,101 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:35,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:35,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f28c888789b361292b656b9a5c9a6421, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:54:35,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:35,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:35,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:35,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:35,106 INFO [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:35,109 DEBUG [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:35,109 DEBUG [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:35,109 INFO [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f28c888789b361292b656b9a5c9a6421 columnFamilyName family1 2023-11-28 14:54:35,110 INFO [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] regionserver.HStore(310): Store=f28c888789b361292b656b9a5c9a6421/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:35,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:35,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:35,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:35,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f28c888789b361292b656b9a5c9a6421; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69942290, jitterRate=0.04222133755683899}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:54:35,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:35,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421., pid=57, masterSystemTime=1701183275101 2023-11-28 14:54:35,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:35,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:35,119 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:35,119 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183275119"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183275119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183275119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183275119"}]},"ts":"1701183275119"} 2023-11-28 14:54:35,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=57, resume processing ppid=56 2023-11-28 14:54:35,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531 in 170 msec 2023-11-28 14:54:35,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=56, resume processing ppid=55 2023-11-28 14:54:35,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, ASSIGN in 328 msec 2023-11-28 14:54:35,124 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:54:35,124 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183275124"}]},"ts":"1701183275124"} 2023-11-28 14:54:35,125 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-28 14:54:35,127 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:54:35,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1680 sec 2023-11-28 14:54:36,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-28 14:54:36,070 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-28 14:54:36,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:36,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,096 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:36,096 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:36,096 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:36,096 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:36,097 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,097 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,098 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,098 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:36,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:36,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:36,099 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,099 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:36,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:36,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,100 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:36,100 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:36,100 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:36,103 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:36,103 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:36,104 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:36,104 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:36,104 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-28 14:54:36,529 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d704050cbb534d158f0315d4efc433e1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d704050cbb534d158f0315d4efc433e1 2023-11-28 14:54:36,933 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/3a17577cf5fb4f26b1d56c9f1f4b7eef 2023-11-28 14:54:36,938 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/3a17577cf5fb4f26b1d56c9f1f4b7eef as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3a17577cf5fb4f26b1d56c9f1f4b7eef 2023-11-28 14:54:36,943 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3a17577cf5fb4f26b1d56c9f1f4b7eef, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-28 14:54:36,944 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 840ms, sequenceid=5, compaction requested=false 2023-11-28 14:54:36,944 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:36,944 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:36,944 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:36,944 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:36,944 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:36,945 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,945 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:36,945 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:36,946 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,946 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:36,947 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,947 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:36,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:36,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:36,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@657b9ce3[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:36,949 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:36,949 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,951 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,951 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:36,951 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:36,951 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:36,951 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,951 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:36,953 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,953 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:36,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:36,953 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:36,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:36,953 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:36,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:36,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:36,956 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:36,956 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:36,956 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:36,956 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,956 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:36,959 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,959 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,959 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:36,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:36,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:36,960 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:36,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,961 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:36,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:36,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:36,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:36,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:36,964 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:36,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:36,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-28 14:54:36,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:36,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:36,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,964 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:36,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:36,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:36,965 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:36,965 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:37,065 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:37,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:37,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:37,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:37,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,072 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:37,072 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:37,072 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:37,072 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:37,072 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,072 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,074 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:37,074 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:37,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:37,074 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,074 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:37,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:37,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,075 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,075 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-28 14:54:37,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,075 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:37,075 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:37,075 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:37,075 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:37,075 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:37,075 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:37,076 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:37,076 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-28 14:54:37,132 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:54:37,488 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e91b89bfee7541739b13a6709e5efcab to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e91b89bfee7541739b13a6709e5efcab 2023-11-28 14:54:37,894 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/16af0875506f4b88b25a6077eeee344c 2023-11-28 14:54:37,898 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/16af0875506f4b88b25a6077eeee344c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/16af0875506f4b88b25a6077eeee344c 2023-11-28 14:54:37,902 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/16af0875506f4b88b25a6077eeee344c, entries=1, sequenceid=9, filesize=5.0 K 2023-11-28 14:54:37,903 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 827ms, sequenceid=9, compaction requested=false 2023-11-28 14:54:37,903 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:37,903 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:37,903 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:37,903 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:37,903 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,903 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:37,903 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:37,905 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,906 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:37,906 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,906 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:37,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:37,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:37,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4995385[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:37,907 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:37,907 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,908 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:37,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:37,909 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,909 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:37,910 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:37,910 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:37,910 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,910 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:37,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:37,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:37,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:37,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:37,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:37,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:37,913 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:37,913 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:37,913 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:37,913 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,913 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:37,915 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,915 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:37,915 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:37,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:37,915 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:37,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,917 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:37,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:37,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:37,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,920 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:37,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:37,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:37,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:37,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:37,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:37,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:37,921 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:37,921 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:37,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:37,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:38,021 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:38,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:38,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:38,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:38,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,027 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:38,027 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:38,028 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:38,028 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:38,028 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,028 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,029 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,029 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:38,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:38,029 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,030 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,030 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,031 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-28 14:54:38,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:38,031 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:38,031 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:38,031 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:38,031 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:38,448 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b666207baa024a32b94ccc29f4bb1f49 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b666207baa024a32b94ccc29f4bb1f49 2023-11-28 14:54:38,853 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/8ca5ea53e7b54035b85098c2aff470ed 2023-11-28 14:54:38,858 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/8ca5ea53e7b54035b85098c2aff470ed as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/8ca5ea53e7b54035b85098c2aff470ed 2023-11-28 14:54:38,862 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/8ca5ea53e7b54035b85098c2aff470ed, entries=1, sequenceid=13, filesize=5.0 K 2023-11-28 14:54:38,862 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 831ms, sequenceid=13, compaction requested=true 2023-11-28 14:54:38,863 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:38,863 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:38,863 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:38,863 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:38,863 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,863 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:38,863 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:38,865 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,865 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:38,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:38,865 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,865 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:38,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:38,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:38,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:38,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:38,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72000b1b[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:38,867 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:38,867 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,868 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,868 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:38,868 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:38,868 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:38,868 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,868 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:38,870 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:38,870 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:38,870 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,870 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:38,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:38,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:38,873 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:38,873 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:38,873 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:38,873 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,873 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:38,876 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,876 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:38,876 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,876 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:38,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,877 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,882 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,882 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:38,882 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:38,883 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,883 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:38,883 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:38,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-28 14:54:38,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:38,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:38,883 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,883 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:38,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:38,883 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:38,883 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,883 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:38,883 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:38,983 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:38,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:38,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:38,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:38,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,990 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:38,990 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:38,990 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:38,990 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:38,990 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,990 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,994 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,994 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:38,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:38,994 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:38,994 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,995 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,995 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-28 14:54:38,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:38,995 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:38,995 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:38,996 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:38,996 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:38,996 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:39,409 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120549714c64d8f9480f992ede8a27ef3918 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120549714c64d8f9480f992ede8a27ef3918 2023-11-28 14:54:39,815 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/18bc985255d9471dacaf104c696a3aa3 2023-11-28 14:54:39,819 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/18bc985255d9471dacaf104c696a3aa3 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/18bc985255d9471dacaf104c696a3aa3 2023-11-28 14:54:39,823 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/18bc985255d9471dacaf104c696a3aa3, entries=1, sequenceid=17, filesize=5.0 K 2023-11-28 14:54:39,824 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 828ms, sequenceid=17, compaction requested=true 2023-11-28 14:54:39,824 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:39,824 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:39,824 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:39,824 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:39,824 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,824 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:39,824 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:39,826 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,826 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:39,826 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,826 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:39,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:39,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1be3e3f4[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:39,828 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:39,828 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,829 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,829 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:39,829 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:39,829 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:39,829 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,829 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:39,831 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:39,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:39,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:39,834 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:39,834 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:39,834 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:39,834 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,834 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:39,836 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,836 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:39,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:39,836 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:39,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:39,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:39,836 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:39,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,838 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:39,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:39,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:39,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:39,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,840 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:39,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,840 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:39,841 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:39,941 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:39,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:39,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:39,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:39,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,947 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:39,947 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:39,947 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:39,947 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:39,948 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,948 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,949 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:39,949 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:39,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:39,949 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:39,949 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:39,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:39,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,950 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,950 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-28 14:54:39,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:39,950 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:39,950 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:39,950 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:39,951 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:39,951 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:39,951 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:39,951 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:39,951 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:40,366 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ac920ecd99bf46ed8e87b73e5d582c91 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac920ecd99bf46ed8e87b73e5d582c91 2023-11-28 14:54:40,776 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/dfff21d2bfd74f65a32cb8a0245b85c5 2023-11-28 14:54:40,780 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/dfff21d2bfd74f65a32cb8a0245b85c5 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/dfff21d2bfd74f65a32cb8a0245b85c5 2023-11-28 14:54:40,784 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/dfff21d2bfd74f65a32cb8a0245b85c5, entries=1, sequenceid=21, filesize=5.0 K 2023-11-28 14:54:40,785 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 834ms, sequenceid=21, compaction requested=true 2023-11-28 14:54:40,785 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:40,785 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:40,785 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:40,789 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,789 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:40,789 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,789 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:40,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22c6e8ef[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:40,791 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:40,791 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,792 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,792 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:40,792 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:40,792 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:40,792 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,792 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:40,793 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,793 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:40,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:40,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:40,793 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:40,794 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:40,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:40,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:40,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:40,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:40,796 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:40,796 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:40,796 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:40,796 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,796 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:40,797 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,797 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:40,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,798 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:40,798 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:40,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,799 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:40,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:40,803 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:40,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:40,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:40,803 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:40,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:40,904 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:40,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:40,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:40,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:40,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,910 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:40,910 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:40,910 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:40,910 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:40,911 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,911 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,912 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,912 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:40,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:40,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:40,913 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:40,913 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:40,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:40,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,914 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,914 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-28 14:54:40,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:40,914 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:40,914 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:40,914 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:40,916 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:40,916 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:40,916 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:40,916 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:40,916 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:41,329 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b8da6177817b435c801ff373fe21e3a4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b8da6177817b435c801ff373fe21e3a4 2023-11-28 14:54:41,735 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/70b82ce893ef4794b5a342b271c5f8f3 2023-11-28 14:54:41,739 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/70b82ce893ef4794b5a342b271c5f8f3 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/70b82ce893ef4794b5a342b271c5f8f3 2023-11-28 14:54:41,743 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/70b82ce893ef4794b5a342b271c5f8f3, entries=1, sequenceid=25, filesize=5.0 K 2023-11-28 14:54:41,744 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 828ms, sequenceid=25, compaction requested=true 2023-11-28 14:54:41,744 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:41,744 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:41,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:41,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:41,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:41,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:41,746 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,746 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:41,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:41,746 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:41,746 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:41,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:41,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:41,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:41,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c8d9249[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:41,747 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:41,747 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,749 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,749 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:41,749 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:41,749 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:41,749 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,749 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:41,751 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,751 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:41,751 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:41,751 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:41,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:41,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:41,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:41,753 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:41,753 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:41,753 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:41,753 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,753 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:41,755 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,755 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:41,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,755 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:41,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:41,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:41,756 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,757 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,759 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,759 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:41,759 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,760 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:41,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:41,759 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:41,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:41,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:41,760 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,760 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,760 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:41,760 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,760 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:41,760 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:41,760 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,860 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:41,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:41,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:41,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:41,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,866 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:41,866 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:41,867 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:41,867 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:41,867 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,867 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,869 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:41,869 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:41,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:41,870 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,870 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:41,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:41,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,870 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,871 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-28 14:54:41,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:41,871 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:41,871 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:41,871 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:41,871 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:41,871 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:41,871 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:41,871 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:41,871 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:41,883 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d1a1f61b152449198c270df70f68f913 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d1a1f61b152449198c270df70f68f913 2023-11-28 14:54:42,288 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/6fd3d571783b44ea894fabacc34d9232 2023-11-28 14:54:42,293 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/6fd3d571783b44ea894fabacc34d9232 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/6fd3d571783b44ea894fabacc34d9232 2023-11-28 14:54:42,298 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/6fd3d571783b44ea894fabacc34d9232, entries=1, sequenceid=29, filesize=5.0 K 2023-11-28 14:54:42,299 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 428ms, sequenceid=29, compaction requested=true 2023-11-28 14:54:42,299 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:42,299 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:42,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,301 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:42,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:42,301 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:42,301 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:42,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:42,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:42,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:42,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ea71410[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:42,302 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:42,303 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,304 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:42,304 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,304 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:42,305 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,305 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:42,305 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:42,305 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:42,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:42,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:42,308 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:42,308 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:42,308 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:42,308 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,308 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:42,310 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,310 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,310 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:42,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:42,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:42,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:42,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:42,311 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,312 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,314 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,314 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:42,314 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,314 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:42,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:42,314 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:42,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-28 14:54:42,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:42,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:42,314 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,315 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,315 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,315 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,315 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:42,315 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:42,315 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:42,415 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:42,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:42,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:42,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:42,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,428 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:42,428 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:42,428 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:42,428 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:42,429 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,429 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,430 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,431 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:42,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:42,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:42,431 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:42,431 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:42,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:42,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,432 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,436 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-28 14:54:42,436 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:42,436 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:42,436 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:42,436 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:42,437 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:42,437 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:42,437 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:42,437 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:42,437 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:42,858 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b96176cf311b4709984dc14e91395262 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103b96176cf311b4709984dc14e91395262 2023-11-28 14:54:43,264 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/f69f19b927be4442af50716331f5fa3e 2023-11-28 14:54:43,269 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/f69f19b927be4442af50716331f5fa3e as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/f69f19b927be4442af50716331f5fa3e 2023-11-28 14:54:43,272 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/f69f19b927be4442af50716331f5fa3e, entries=1, sequenceid=33, filesize=5.0 K 2023-11-28 14:54:43,273 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 836ms, sequenceid=33, compaction requested=true 2023-11-28 14:54:43,273 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:43,273 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:43,273 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,274 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:43,274 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:43,275 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,275 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:43,275 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,275 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:43,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:43,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1adfa873[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:43,277 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:43,277 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,279 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,280 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:43,280 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:43,280 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:43,280 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,280 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:43,287 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:43,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:43,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:43,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:43,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:43,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:43,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:43,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:43,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:43,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:43,289 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:43,289 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:43,289 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:43,289 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,289 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:43,291 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,291 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:43,291 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:43,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,291 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:43,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:43,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,296 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,300 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,300 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,300 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:43,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:43,300 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:43,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:43,300 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,300 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,300 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:43,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:43,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:43,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,301 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,301 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:43,301 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:43,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:43,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-28 14:54:43,401 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:43,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:43,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:43,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:43,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,407 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:43,407 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:43,407 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:43,408 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:43,408 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,408 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,409 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:43,409 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:43,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:43,410 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,410 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:43,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:43,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,411 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,411 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-28 14:54:43,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,411 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:43,411 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:43,411 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:43,411 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:43,411 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:43,411 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:43,411 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:43,411 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:43,829 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f545618851c5420bb479c4e342d71262 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907f545618851c5420bb479c4e342d71262 2023-11-28 14:54:43,835 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/b0db6111e163466bb80a9a71dc5e11a5 2023-11-28 14:54:43,840 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/b0db6111e163466bb80a9a71dc5e11a5 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/b0db6111e163466bb80a9a71dc5e11a5 2023-11-28 14:54:43,845 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/b0db6111e163466bb80a9a71dc5e11a5, entries=1, sequenceid=37, filesize=5.0 K 2023-11-28 14:54:43,846 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 435ms, sequenceid=37, compaction requested=true 2023-11-28 14:54:43,846 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:43,846 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:43,846 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:43,846 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:43,846 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,846 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:43,846 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:43,848 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,848 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:43,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:43,849 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,849 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:43,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:43,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:43,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:43,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:43,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f4baa57[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:43,851 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:43,851 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,852 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:43,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:43,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:43,852 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,852 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:43,857 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:43,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:43,860 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:43,860 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:43,860 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:43,860 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,860 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:43,862 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,862 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:43,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,862 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:43,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:43,863 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,864 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:43,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,866 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:43,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-28 14:54:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:43,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:43,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:43,867 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:43,867 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:43,968 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:43,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:43,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:43,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:43,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,974 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:43,974 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:43,974 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-28 14:54:43,974 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-28 14:54:43,975 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,975 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,976 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,976 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:43,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:43,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:43,976 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:43,976 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:43,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:43,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,977 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,977 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-28 14:54:43,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-28 14:54:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-28 14:54:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:54:43,978 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:43,978 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:43,978 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. started... 2023-11-28 14:54:43,978 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f28c888789b361292b656b9a5c9a6421 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:54:44,392 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203572925e769949dcbdbb3abc65b39e86 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511203572925e769949dcbdbb3abc65b39e86 2023-11-28 14:54:44,798 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/47277d39391c4d2ca0f4c6990e750303 2023-11-28 14:54:44,803 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/47277d39391c4d2ca0f4c6990e750303 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/47277d39391c4d2ca0f4c6990e750303 2023-11-28 14:54:44,807 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/47277d39391c4d2ca0f4c6990e750303, entries=1, sequenceid=41, filesize=5.0 K 2023-11-28 14:54:44,808 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f28c888789b361292b656b9a5c9a6421 in 830ms, sequenceid=41, compaction requested=true 2023-11-28 14:54:44,808 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:44,808 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:44,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:54:44,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:54:44,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-28 14:54:44,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-28 14:54:44,811 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,811 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:44,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:44,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-28 14:54:44,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f547e2d[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:44,813 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-28 14:54:44,813 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,814 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,814 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-28 14:54:44,814 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-28 14:54:44,814 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:44,814 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,814 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:44,815 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,815 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-28 14:54:44,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:44,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:44,815 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:44,815 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-28 14:54:44,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:44,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:44,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:44,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:44,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-28 14:54:44,818 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-28 14:54:44,818 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:44,818 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:44,818 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,818 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:44,819 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,819 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,819 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:44,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:44,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:44,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:44,820 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:44,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:44,821 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:44,827 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-28 14:54:44,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:44,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:44,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:44,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:44,827 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:44,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:44,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:44,928 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:44,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:44,929 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:44,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-28 14:54:44,931 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-28 14:54:44,932 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183884932 2023-11-28 14:54:44,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:44,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:54:44,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-28 14:54:44,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:44,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x7806f9ed to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:44,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75f8e081, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:44,942 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:45,779 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103138beb163cef4553876604d71151ceae to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103138beb163cef4553876604d71151ceae 2023-11-28 14:54:45,780 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:45,799 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:54:45,800 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:54:45,809 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:54:45,810 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:54:45,822 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8d5bfad5919842e2893f58571bff4ccc first=Optional[r3] last=Optional[r6] 2023-11-28 14:54:45,822 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8d5bfad5919842e2893f58571bff4ccc}] 2023-11-28 14:54:45,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8d5bfad5919842e2893f58571bff4ccc for inclusion in f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:45,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-28 14:54:45,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:45,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:45,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8d5bfad5919842e2893f58571bff4ccc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u2a2jb5m4sf0kuq0hu06sfjjciis6dn06jv0j0ll76c6736k8h695mc7u38q1qsr/family1/8d5bfad5919842e2893f58571bff4ccc 2023-11-28 14:54:45,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u2a2jb5m4sf0kuq0hu06sfjjciis6dn06jv0j0ll76c6736k8h695mc7u38q1qsr/family1/8d5bfad5919842e2893f58571bff4ccc as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/2eea1f08bf4f4701b407b9ed5b7e9b84_SeqId_44_ 2023-11-28 14:54:45,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u2a2jb5m4sf0kuq0hu06sfjjciis6dn06jv0j0ll76c6736k8h695mc7u38q1qsr/family1/8d5bfad5919842e2893f58571bff4ccc into f28c888789b361292b656b9a5c9a6421/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/2eea1f08bf4f4701b407b9ed5b7e9b84_SeqId_44_ - updating store file list. 2023-11-28 14:54:45,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/2eea1f08bf4f4701b407b9ed5b7e9b84_SeqId_44_ into f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:45,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u2a2jb5m4sf0kuq0hu06sfjjciis6dn06jv0j0ll76c6736k8h695mc7u38q1qsr/family1/8d5bfad5919842e2893f58571bff4ccc into f28c888789b361292b656b9a5c9a6421/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/2eea1f08bf4f4701b407b9ed5b7e9b84_SeqId_44_) 2023-11-28 14:54:45,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u2a2jb5m4sf0kuq0hu06sfjjciis6dn06jv0j0ll76c6736k8h695mc7u38q1qsr/family1/8d5bfad5919842e2893f58571bff4ccc 2023-11-28 14:54:45,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-28 14:54:45,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-28 14:54:45,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): f28c888789b361292b656b9a5c9a6421/family1 is initiating minor compaction 2023-11-28 14:54:45,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@466cfc6c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:45,843 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f28c888789b361292b656b9a5c9a6421/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:45,843 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/16af0875506f4b88b25a6077eeee344c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/8ca5ea53e7b54035b85098c2aff470ed, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/18bc985255d9471dacaf104c696a3aa3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/dfff21d2bfd74f65a32cb8a0245b85c5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/70b82ce893ef4794b5a342b271c5f8f3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/6fd3d571783b44ea894fabacc34d9232, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/f69f19b927be4442af50716331f5fa3e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/b0db6111e163466bb80a9a71dc5e11a5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/47277d39391c4d2ca0f4c6990e750303, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/2eea1f08bf4f4701b407b9ed5b7e9b84_SeqId_44_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp, totalSize=50.3 K 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 16af0875506f4b88b25a6077eeee344c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 8ca5ea53e7b54035b85098c2aff470ed, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 18bc985255d9471dacaf104c696a3aa3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting dfff21d2bfd74f65a32cb8a0245b85c5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 70b82ce893ef4794b5a342b271c5f8f3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 6fd3d571783b44ea894fabacc34d9232, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting f69f19b927be4442af50716331f5fa3e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting b0db6111e163466bb80a9a71dc5e11a5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 47277d39391c4d2ca0f4c6990e750303, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-28 14:54:45,843 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 2eea1f08bf4f4701b407b9ed5b7e9b84_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-28 14:54:45,845 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:45,846 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:45,850 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac920ecd99bf46ed8e87b73e5d582c91 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac920ecd99bf46ed8e87b73e5d582c91 2023-11-28 14:54:45,851 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b8da6177817b435c801ff373fe21e3a4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231b8da6177817b435c801ff373fe21e3a4 2023-11-28 14:54:45,852 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d1a1f61b152449198c270df70f68f913 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d1a1f61b152449198c270df70f68f913 2023-11-28 14:54:45,854 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103b96176cf311b4709984dc14e91395262 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103b96176cf311b4709984dc14e91395262 2023-11-28 14:54:45,854 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-28 14:54:45,854 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-28 14:54:45,854 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:45,854 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:45,854 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:45,854 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:45,854 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:45,854 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:45,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:45,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:45,872 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): f28c888789b361292b656b9a5c9a6421#family1#compaction#71 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:54:46,302 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/4256477adb0d42d493900ed5e1f0d04d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4256477adb0d42d493900ed5e1f0d04d 2023-11-28 14:54:46,307 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f28c888789b361292b656b9a5c9a6421/family1 of f28c888789b361292b656b9a5c9a6421 into 4256477adb0d42d493900ed5e1f0d04d(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:54:46,307 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:46,307 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1701183285842; duration=0sec 2023-11-28 14:54:46,307 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:46,318 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120553e4b44c10a141aaa861701134a459e6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120553e4b44c10a141aaa861701134a459e6 2023-11-28 14:54:46,319 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:46,345 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f834130530344b2c99e8870f318765cc first=Optional[r00] last=Optional[r2] 2023-11-28 14:54:46,346 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f834130530344b2c99e8870f318765cc}] 2023-11-28 14:54:46,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f834130530344b2c99e8870f318765cc for inclusion in f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:46,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-28 14:54:46,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:46,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:46,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f834130530344b2c99e8870f318765cc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__87bnbidhmfkcq4s3li0kq7666psuef41hmgjdb6cg2pqd8f1936pbf49su7q6dgh/family1/f834130530344b2c99e8870f318765cc 2023-11-28 14:54:46,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__87bnbidhmfkcq4s3li0kq7666psuef41hmgjdb6cg2pqd8f1936pbf49su7q6dgh/family1/f834130530344b2c99e8870f318765cc as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4b72b2f9381c443ca208ddb953710358_SeqId_47_ 2023-11-28 14:54:46,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__87bnbidhmfkcq4s3li0kq7666psuef41hmgjdb6cg2pqd8f1936pbf49su7q6dgh/family1/f834130530344b2c99e8870f318765cc into f28c888789b361292b656b9a5c9a6421/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4b72b2f9381c443ca208ddb953710358_SeqId_47_ - updating store file list. 2023-11-28 14:54:46,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4b72b2f9381c443ca208ddb953710358_SeqId_47_ into f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:46,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__87bnbidhmfkcq4s3li0kq7666psuef41hmgjdb6cg2pqd8f1936pbf49su7q6dgh/family1/f834130530344b2c99e8870f318765cc into f28c888789b361292b656b9a5c9a6421/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4b72b2f9381c443ca208ddb953710358_SeqId_47_) 2023-11-28 14:54:46,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__87bnbidhmfkcq4s3li0kq7666psuef41hmgjdb6cg2pqd8f1936pbf49su7q6dgh/family1/f834130530344b2c99e8870f318765cc 2023-11-28 14:54:46,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-28 14:54:46,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-28 14:54:46,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): f28c888789b361292b656b9a5c9a6421/family1 is initiating minor compaction (all files) 2023-11-28 14:54:46,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@37063297; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:46,360 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f28c888789b361292b656b9a5c9a6421/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:46,360 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3a17577cf5fb4f26b1d56c9f1f4b7eef, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4256477adb0d42d493900ed5e1f0d04d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4b72b2f9381c443ca208ddb953710358_SeqId_47_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp, totalSize=388.1 K 2023-11-28 14:54:46,361 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 3a17577cf5fb4f26b1d56c9f1f4b7eef, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824829 2023-11-28 14:54:46,361 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 4256477adb0d42d493900ed5e1f0d04d, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224829 2023-11-28 14:54:46,362 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 4b72b2f9381c443ca208ddb953710358_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824829 2023-11-28 14:54:46,362 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:46,363 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:46,364 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d704050cbb534d158f0315d4efc433e1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d704050cbb534d158f0315d4efc433e1 2023-11-28 14:54:46,365 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b666207baa024a32b94ccc29f4bb1f49 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201b666207baa024a32b94ccc29f4bb1f49 2023-11-28 14:54:46,367 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120549714c64d8f9480f992ede8a27ef3918 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120549714c64d8f9480f992ede8a27ef3918 2023-11-28 14:54:46,367 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-28 14:54:46,367 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-28 14:54:46,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:46,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:46,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:46,368 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-28 14:54:46,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4390 sec 2023-11-28 14:54:46,380 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): f28c888789b361292b656b9a5c9a6421#family1#compaction#72 average throughput is 17.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:54:46,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/16af0875506f4b88b25a6077eeee344c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/8ca5ea53e7b54035b85098c2aff470ed, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/18bc985255d9471dacaf104c696a3aa3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/dfff21d2bfd74f65a32cb8a0245b85c5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/70b82ce893ef4794b5a342b271c5f8f3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/6fd3d571783b44ea894fabacc34d9232, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/f69f19b927be4442af50716331f5fa3e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/b0db6111e163466bb80a9a71dc5e11a5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/47277d39391c4d2ca0f4c6990e750303, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/2eea1f08bf4f4701b407b9ed5b7e9b84_SeqId_44_] to archive 2023-11-28 14:54:46,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:46,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/16af0875506f4b88b25a6077eeee344c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/16af0875506f4b88b25a6077eeee344c 2023-11-28 14:54:46,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/8ca5ea53e7b54035b85098c2aff470ed to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/8ca5ea53e7b54035b85098c2aff470ed 2023-11-28 14:54:46,419 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/18bc985255d9471dacaf104c696a3aa3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/18bc985255d9471dacaf104c696a3aa3 2023-11-28 14:54:46,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/dfff21d2bfd74f65a32cb8a0245b85c5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/dfff21d2bfd74f65a32cb8a0245b85c5 2023-11-28 14:54:46,422 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/70b82ce893ef4794b5a342b271c5f8f3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/70b82ce893ef4794b5a342b271c5f8f3 2023-11-28 14:54:46,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/6fd3d571783b44ea894fabacc34d9232 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/6fd3d571783b44ea894fabacc34d9232 2023-11-28 14:54:46,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/f69f19b927be4442af50716331f5fa3e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/f69f19b927be4442af50716331f5fa3e 2023-11-28 14:54:46,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/b0db6111e163466bb80a9a71dc5e11a5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/b0db6111e163466bb80a9a71dc5e11a5 2023-11-28 14:54:46,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/47277d39391c4d2ca0f4c6990e750303 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/47277d39391c4d2ca0f4c6990e750303 2023-11-28 14:54:46,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/2eea1f08bf4f4701b407b9ed5b7e9b84_SeqId_44_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/2eea1f08bf4f4701b407b9ed5b7e9b84_SeqId_44_ 2023-11-28 14:54:46,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-28 14:54:46,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:46,859 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-28 14:54:46,860 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-28 14:54:46,860 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-28 14:54:46,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-28 14:54:46,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, REOPEN/MOVE}] 2023-11-28 14:54:46,865 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, REOPEN/MOVE 2023-11-28 14:54:46,866 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:46,866 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183286866"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183286866"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183286866"}]},"ts":"1701183286866"} 2023-11-28 14:54:46,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:47,018 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:47,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:47,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f28c888789b361292b656b9a5c9a6421, disabling compactions & flushes 2023-11-28 14:54:47,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:47,598 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/.tmp/family1/ee9a33c8d8cc455f9f09e39f9f8e4b32 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/ee9a33c8d8cc455f9f09e39f9f8e4b32 2023-11-28 14:54:47,603 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f28c888789b361292b656b9a5c9a6421/family1 of f28c888789b361292b656b9a5c9a6421 into ee9a33c8d8cc455f9f09e39f9f8e4b32(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:54:47,603 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:47,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:47,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:47,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. after waiting 0 ms 2023-11-28 14:54:47,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:47,603 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1701183286360; duration=1sec 2023-11-28 14:54:47,603 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:47,606 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3a17577cf5fb4f26b1d56c9f1f4b7eef, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4256477adb0d42d493900ed5e1f0d04d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4b72b2f9381c443ca208ddb953710358_SeqId_47_] to archive 2023-11-28 14:54:47,607 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:47,608 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3a17577cf5fb4f26b1d56c9f1f4b7eef to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3a17577cf5fb4f26b1d56c9f1f4b7eef 2023-11-28 14:54:47,609 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4256477adb0d42d493900ed5e1f0d04d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4256477adb0d42d493900ed5e1f0d04d 2023-11-28 14:54:47,610 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4b72b2f9381c443ca208ddb953710358_SeqId_47_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/4b72b2f9381c443ca208ddb953710358_SeqId_47_ 2023-11-28 14:54:47,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-28 14:54:47,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:47,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:47,615 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: f28c888789b361292b656b9a5c9a6421 to self. 2023-11-28 14:54:47,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:47,617 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=CLOSED 2023-11-28 14:54:47,617 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183287617"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183287617"}]},"ts":"1701183287617"} 2023-11-28 14:54:47,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=62, resume processing ppid=61 2023-11-28 14:54:47,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531 in 751 msec 2023-11-28 14:54:47,620 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=true 2023-11-28 14:54:47,770 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:47,770 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183287770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183287770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183287770"}]},"ts":"1701183287770"} 2023-11-28 14:54:47,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:47,923 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:47,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:47,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f28c888789b361292b656b9a5c9a6421, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:54:47,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:47,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:47,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:47,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:47,928 INFO [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:47,929 DEBUG [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:47,929 DEBUG [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:47,930 INFO [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f28c888789b361292b656b9a5c9a6421 columnFamilyName family1 2023-11-28 14:54:47,935 DEBUG [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/ee9a33c8d8cc455f9f09e39f9f8e4b32 2023-11-28 14:54:47,935 INFO [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] regionserver.HStore(310): Store=f28c888789b361292b656b9a5c9a6421/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:47,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:47,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:47,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:47,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f28c888789b361292b656b9a5c9a6421; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72102514, jitterRate=0.07441118359565735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:54:47,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:47,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421., pid=63, masterSystemTime=1701183287923 2023-11-28 14:54:47,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:47,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:47,942 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:47,942 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183287942"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183287942"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183287942"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183287942"}]},"ts":"1701183287942"} 2023-11-28 14:54:47,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=63, resume processing ppid=61 2023-11-28 14:54:47,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531 in 171 msec 2023-11-28 14:54:47,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=61, resume processing ppid=60 2023-11-28 14:54:47,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, REOPEN/MOVE in 1.0790 sec 2023-11-28 14:54:47,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=60, resume processing ppid=59 2023-11-28 14:54:47,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0840 sec 2023-11-28 14:54:47,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5030 sec 2023-11-28 14:54:47,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-28 14:54:47,951 INFO [Listener at localhost/45519] compactions.TestMobCompactor(278): alter status finished 2023-11-28 14:54:47,952 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:47,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-28 14:54:47,953 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-28 14:54:47,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:47,954 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183887954 2023-11-28 14:54:47,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:54:47,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-28 14:54:47,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:47,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x6dc10ad5 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:47,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@232ea689, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:47,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:47,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:47,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:47,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:47,962 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:48,789 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283aff1afa24e048829fe12efb70418dd6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511283aff1afa24e048829fe12efb70418dd6 2023-11-28 14:54:48,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:48,805 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:54:48,806 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:54:48,812 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:54:48,814 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:54:48,822 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bf6f66ecbf264486b755defdd1aca279 first=Optional[r05] last=Optional[r8] 2023-11-28 14:54:48,822 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=51 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bf6f66ecbf264486b755defdd1aca279}] 2023-11-28 14:54:48,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bf6f66ecbf264486b755defdd1aca279 for inclusion in f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:48,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-28 14:54:48,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:48,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:48,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bf6f66ecbf264486b755defdd1aca279 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g3hm8rlkcpraikbohup0j59lnp5g398i2ro3nak60kqvsc8ion0tae571lg3c1ol/family1/bf6f66ecbf264486b755defdd1aca279 2023-11-28 14:54:48,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g3hm8rlkcpraikbohup0j59lnp5g398i2ro3nak60kqvsc8ion0tae571lg3c1ol/family1/bf6f66ecbf264486b755defdd1aca279 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3d04fe6e257f49468b776b7ff0976fa3_SeqId_53_ 2023-11-28 14:54:48,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g3hm8rlkcpraikbohup0j59lnp5g398i2ro3nak60kqvsc8ion0tae571lg3c1ol/family1/bf6f66ecbf264486b755defdd1aca279 into f28c888789b361292b656b9a5c9a6421/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3d04fe6e257f49468b776b7ff0976fa3_SeqId_53_ - updating store file list. 2023-11-28 14:54:48,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3d04fe6e257f49468b776b7ff0976fa3_SeqId_53_ into f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:48,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g3hm8rlkcpraikbohup0j59lnp5g398i2ro3nak60kqvsc8ion0tae571lg3c1ol/family1/bf6f66ecbf264486b755defdd1aca279 into f28c888789b361292b656b9a5c9a6421/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3d04fe6e257f49468b776b7ff0976fa3_SeqId_53_) 2023-11-28 14:54:48,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__g3hm8rlkcpraikbohup0j59lnp5g398i2ro3nak60kqvsc8ion0tae571lg3c1ol/family1/bf6f66ecbf264486b755defdd1aca279 2023-11-28 14:54:48,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:48,838 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:48,840 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511203572925e769949dcbdbb3abc65b39e86 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511203572925e769949dcbdbb3abc65b39e86 2023-11-28 14:54:48,841 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e91b89bfee7541739b13a6709e5efcab to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e91b89bfee7541739b13a6709e5efcab 2023-11-28 14:54:48,841 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-28 14:54:48,841 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-28 14:54:48,842 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:48,842 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:48,842 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:48,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:48,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:48,843 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-28 14:54:48,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 891 msec 2023-11-28 14:54:48,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-28 14:54:48,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:49,312 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-28 14:54:49,313 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-28 14:54:49,313 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-28 14:54:49,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-28 14:54:49,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, REOPEN/MOVE}] 2023-11-28 14:54:49,317 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, REOPEN/MOVE 2023-11-28 14:54:49,318 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:49,318 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183289318"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183289318"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183289318"}]},"ts":"1701183289318"} 2023-11-28 14:54:49,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:49,471 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:49,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:49,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f28c888789b361292b656b9a5c9a6421, disabling compactions & flushes 2023-11-28 14:54:49,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:49,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:49,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. after waiting 0 ms 2023-11-28 14:54:49,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:49,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-28 14:54:49,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:49,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:49,480 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: f28c888789b361292b656b9a5c9a6421 to self. 2023-11-28 14:54:49,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:49,481 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=CLOSED 2023-11-28 14:54:49,481 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183289481"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183289481"}]},"ts":"1701183289481"} 2023-11-28 14:54:49,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=68, resume processing ppid=67 2023-11-28 14:54:49,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531 in 163 msec 2023-11-28 14:54:49,484 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=true 2023-11-28 14:54:49,635 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:49,635 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183289634"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183289634"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183289634"}]},"ts":"1701183289634"} 2023-11-28 14:54:49,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:49,788 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:49,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:49,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f28c888789b361292b656b9a5c9a6421, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:54:49,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:49,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:49,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:49,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:49,793 INFO [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:49,794 DEBUG [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:49,794 DEBUG [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1 2023-11-28 14:54:49,794 INFO [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f28c888789b361292b656b9a5c9a6421 columnFamilyName family1 2023-11-28 14:54:49,799 DEBUG [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/3d04fe6e257f49468b776b7ff0976fa3_SeqId_53_ 2023-11-28 14:54:49,802 DEBUG [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/family1/ee9a33c8d8cc455f9f09e39f9f8e4b32 2023-11-28 14:54:49,802 INFO [StoreOpener-f28c888789b361292b656b9a5c9a6421-1] regionserver.HStore(310): Store=f28c888789b361292b656b9a5c9a6421/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:49,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:49,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:49,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:54:49,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f28c888789b361292b656b9a5c9a6421; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65996091, jitterRate=-0.016581609845161438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:54:49,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:54:49,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421., pid=69, masterSystemTime=1701183289788 2023-11-28 14:54:49,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:49,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:54:49,809 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f28c888789b361292b656b9a5c9a6421, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:49,810 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701183289809"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183289809"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183289809"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183289809"}]},"ts":"1701183289809"} 2023-11-28 14:54:49,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=69, resume processing ppid=67 2023-11-28 14:54:49,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure f28c888789b361292b656b9a5c9a6421, server=jenkins-hbase4.apache.org,41403,1701183201531 in 175 msec 2023-11-28 14:54:49,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=67, resume processing ppid=66 2023-11-28 14:54:49,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=f28c888789b361292b656b9a5c9a6421, REOPEN/MOVE in 495 msec 2023-11-28 14:54:49,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=66, resume processing ppid=65 2023-11-28 14:54:49,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 499 msec 2023-11-28 14:54:49,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 913 msec 2023-11-28 14:54:49,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-28 14:54:49,818 INFO [Listener at localhost/45519] compactions.TestMobCompactor(278): alter status finished 2023-11-28 14:54:49,819 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-28 14:54:49,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-28 14:54:49,820 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-28 14:54:49,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:49,821 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183889821 2023-11-28 14:54:49,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:54:49,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-28 14:54:49,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:49,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x20675b54 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:49,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b5ec34a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:49,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:49,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:49,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:49,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:49,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:49,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:49,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:49,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-28 14:54:49,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-28 14:54:49,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:49,829 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-28 14:54:49,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-11-28 14:54:49,874 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=258 (was 246) - Thread LEAK? -, OpenFileDescriptor=685 (was 652) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 193), ProcessCount=172 (was 172), AvailableMemoryMB=7655 (was 7671) 2023-11-28 14:54:49,884 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=258, OpenFileDescriptor=685, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=172, AvailableMemoryMB=7654 2023-11-28 14:54:49,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-28 14:54:49,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-28 14:54:49,890 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:54:49,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-28 14:54:49,890 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:54:49,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-28 14:54:49,891 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:49,892 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190 empty. 2023-11-28 14:54:49,892 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:49,892 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-28 14:54:49,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-28 14:54:50,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-28 14:54:50,302 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-28 14:54:50,303 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 16ddac28e3fab0e123c6fd68fba87190, NAME => 'testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:50,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-28 14:54:50,709 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:50,709 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 16ddac28e3fab0e123c6fd68fba87190, disabling compactions & flushes 2023-11-28 14:54:50,710 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:50,710 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:50,710 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. after waiting 0 ms 2023-11-28 14:54:50,710 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:50,710 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:50,710 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 16ddac28e3fab0e123c6fd68fba87190: 2023-11-28 14:54:50,712 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:54:50,713 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701183290713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183290713"}]},"ts":"1701183290713"} 2023-11-28 14:54:50,714 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-28 14:54:50,715 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:54:50,715 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183290715"}]},"ts":"1701183290715"} 2023-11-28 14:54:50,716 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-28 14:54:50,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=16ddac28e3fab0e123c6fd68fba87190, ASSIGN}] 2023-11-28 14:54:50,721 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=16ddac28e3fab0e123c6fd68fba87190, ASSIGN 2023-11-28 14:54:50,722 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=16ddac28e3fab0e123c6fd68fba87190, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:50,873 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=16ddac28e3fab0e123c6fd68fba87190, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:50,873 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701183290873"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183290873"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183290873"}]},"ts":"1701183290873"} 2023-11-28 14:54:50,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 16ddac28e3fab0e123c6fd68fba87190, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:50,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-28 14:54:51,026 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:51,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:51,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 16ddac28e3fab0e123c6fd68fba87190, NAME => 'testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:54:51,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-28 14:54:51,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-28 14:54:51,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:51,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:51,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:51,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:51,032 INFO [StoreOpener-16ddac28e3fab0e123c6fd68fba87190-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:51,033 DEBUG [StoreOpener-16ddac28e3fab0e123c6fd68fba87190-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1 2023-11-28 14:54:51,033 DEBUG [StoreOpener-16ddac28e3fab0e123c6fd68fba87190-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1 2023-11-28 14:54:51,034 INFO [StoreOpener-16ddac28e3fab0e123c6fd68fba87190-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 16ddac28e3fab0e123c6fd68fba87190 columnFamilyName f1 2023-11-28 14:54:51,035 INFO [StoreOpener-16ddac28e3fab0e123c6fd68fba87190-1] regionserver.HStore(310): Store=16ddac28e3fab0e123c6fd68fba87190/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:51,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:51,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:51,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:51,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:51,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 16ddac28e3fab0e123c6fd68fba87190; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69062118, jitterRate=0.02910575270652771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:54:51,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 16ddac28e3fab0e123c6fd68fba87190: 2023-11-28 14:54:51,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190., pid=73, masterSystemTime=1701183291026 2023-11-28 14:54:51,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:51,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:51,043 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=16ddac28e3fab0e123c6fd68fba87190, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:51,044 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701183291043"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183291043"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183291043"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183291043"}]},"ts":"1701183291043"} 2023-11-28 14:54:51,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=73, resume processing ppid=72 2023-11-28 14:54:51,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 16ddac28e3fab0e123c6fd68fba87190, server=jenkins-hbase4.apache.org,41403,1701183201531 in 171 msec 2023-11-28 14:54:51,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=72, resume processing ppid=71 2023-11-28 14:54:51,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=16ddac28e3fab0e123c6fd68fba87190, ASSIGN in 326 msec 2023-11-28 14:54:51,048 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:54:51,048 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183291048"}]},"ts":"1701183291048"} 2023-11-28 14:54:51,049 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-28 14:54:51,051 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:54:51,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1630 sec 2023-11-28 14:54:51,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-28 14:54:51,996 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-28 14:54:51,996 DEBUG [Listener at localhost/45519] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-28 14:54:51,998 INFO [Listener at localhost/45519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-28 14:54:52,001 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-28 14:54:52,001 INFO [Listener at localhost/45519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-28 14:54:52,001 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-28 14:54:52,005 INFO [Listener at localhost/45519] regionserver.HRegion(2745): Flushing 16ddac28e3fab0e123c6fd68fba87190 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-28 14:54:52,419 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112860ca1dbabd534a42b7b153f180af54d6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112860ca1dbabd534a42b7b153f180af54d6 2023-11-28 14:54:52,824 INFO [Listener at localhost/45519] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/.tmp/f1/b42de8996d484ee78534bb768a4b9293 2023-11-28 14:54:52,829 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/.tmp/f1/b42de8996d484ee78534bb768a4b9293 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293 2023-11-28 14:54:52,834 INFO [Listener at localhost/45519] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293, entries=1, sequenceid=5, filesize=4.9 K 2023-11-28 14:54:52,835 INFO [Listener at localhost/45519] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 16ddac28e3fab0e123c6fd68fba87190 in 830ms, sequenceid=5, compaction requested=false 2023-11-28 14:54:52,835 DEBUG [Listener at localhost/45519] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-28 14:54:52,836 DEBUG [Listener at localhost/45519] regionserver.HRegion(2446): Flush status journal for 16ddac28e3fab0e123c6fd68fba87190: 2023-11-28 14:54:52,838 INFO [Listener at localhost/45519] regionserver.HRegion(2745): Flushing 16ddac28e3fab0e123c6fd68fba87190 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-28 14:54:53,161 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:54:53,251 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112844a92fe7de8b4d0baba6de0d7d962c0e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112844a92fe7de8b4d0baba6de0d7d962c0e 2023-11-28 14:54:53,656 INFO [Listener at localhost/45519] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/.tmp/f1/f7b0dac2c8af45c3b747ff3c6500c112 2023-11-28 14:54:53,661 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/.tmp/f1/f7b0dac2c8af45c3b747ff3c6500c112 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112 2023-11-28 14:54:53,665 INFO [Listener at localhost/45519] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112, entries=1, sequenceid=9, filesize=4.9 K 2023-11-28 14:54:53,666 INFO [Listener at localhost/45519] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 16ddac28e3fab0e123c6fd68fba87190 in 828ms, sequenceid=9, compaction requested=false 2023-11-28 14:54:53,666 DEBUG [Listener at localhost/45519] regionserver.HRegion(2446): Flush status journal for 16ddac28e3fab0e123c6fd68fba87190: 2023-11-28 14:54:53,667 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-28 14:54:53,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-28 14:54:53,669 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-28 14:54:53,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:53,670 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183893670 2023-11-28 14:54:53,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-28 14:54:53,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-28 14:54:53,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-28 14:54:53,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x70de5604 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:54:53,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d378fc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:54:53,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231128 for table='testGetAfterCompaction' and column='f1' 2023-11-28 14:54:53,719 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:53,719 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:53,770 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:53,770 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:53,821 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:53,821 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:53,872 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:53,872 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,054 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:54:54,054 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-28 14:54:54,054 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f6838a3 to 127.0.0.1:62725 2023-11-28 14:54:54,054 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:54,055 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:54:54,055 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f541d05 to 127.0.0.1:62725 2023-11-28 14:54:54,055 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:54,055 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38cce73d to 127.0.0.1:62725 2023-11-28 14:54:54,055 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:54,055 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,055 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:54:54,055 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,055 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a1b2bdc to 127.0.0.1:62725 2023-11-28 14:54:54,056 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:54,056 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:54:54,056 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7806f9ed to 127.0.0.1:62725 2023-11-28 14:54:54,056 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:54,056 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20675b54 to 127.0.0.1:62725 2023-11-28 14:54:54,056 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:54,057 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:54:54,057 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dc10ad5 to 127.0.0.1:62725 2023-11-28 14:54:54,057 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:54:54,106 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,106 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,157 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,157 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,208 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,208 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,259 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,259 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,310 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,310 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,361 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,361 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,412 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,412 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,462 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,463 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,502 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128dcc5431426f34fa6bf792d0eca61d380 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231128dcc5431426f34fa6bf792d0eca61d380 2023-11-28 14:54:54,503 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='testGetAfterCompaction' column='f1' 2023-11-28 14:54:54,513 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,513 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,517 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:54:54,518 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:54:54,525 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:54:54,527 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:54:54,536 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231128/f1/33ef8d2de79a4e0c9d3cede9f329f83f first=Optional[r1] last=Optional[r2] 2023-11-28 14:54:54,536 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{f1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231128/f1/33ef8d2de79a4e0c9d3cede9f329f83f}] 2023-11-28 14:54:54,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231128/f1/33ef8d2de79a4e0c9d3cede9f329f83f for inclusion in 16ddac28e3fab0e123c6fd68fba87190/f1 2023-11-28 14:54:54,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-28 14:54:54,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:54:54,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 16ddac28e3fab0e123c6fd68fba87190: 2023-11-28 14:54:54,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231128/f1/33ef8d2de79a4e0c9d3cede9f329f83f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testGetAfterCompaction__ca0ucbmh23u4ji0naf79tf855jkavrkattfjm7m1h1jih172kthk1quisv73g9q1/f1/33ef8d2de79a4e0c9d3cede9f329f83f 2023-11-28 14:54:54,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testGetAfterCompaction__ca0ucbmh23u4ji0naf79tf855jkavrkattfjm7m1h1jih172kthk1quisv73g9q1/f1/33ef8d2de79a4e0c9d3cede9f329f83f as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_ 2023-11-28 14:54:54,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testGetAfterCompaction__ca0ucbmh23u4ji0naf79tf855jkavrkattfjm7m1h1jih172kthk1quisv73g9q1/f1/33ef8d2de79a4e0c9d3cede9f329f83f into 16ddac28e3fab0e123c6fd68fba87190/f1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_ - updating store file list. 2023-11-28 14:54:54,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_ into 16ddac28e3fab0e123c6fd68fba87190/f1 2023-11-28 14:54:54,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testGetAfterCompaction__ca0ucbmh23u4ji0naf79tf855jkavrkattfjm7m1h1jih172kthk1quisv73g9q1/f1/33ef8d2de79a4e0c9d3cede9f329f83f into 16ddac28e3fab0e123c6fd68fba87190/f1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_) 2023-11-28 14:54:54,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testGetAfterCompaction__ca0ucbmh23u4ji0naf79tf855jkavrkattfjm7m1h1jih172kthk1quisv73g9q1/f1/33ef8d2de79a4e0c9d3cede9f329f83f 2023-11-28 14:54:54,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): 16ddac28e3fab0e123c6fd68fba87190/f1 is initiating minor compaction 2023-11-28 14:54:54,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@138102ff; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:54,550 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 16ddac28e3fab0e123c6fd68fba87190/f1 in testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:54,550 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/.tmp, totalSize=10.0 K 2023-11-28 14:54:54,550 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting f7b0dac2c8af45c3b747ff3c6500c112, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-28 14:54:54,550 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting c87578206b724e1198934ef2a45e5650_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-28 14:54:54,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='testGetAfterCompaction' column='f1' 2023-11-28 14:54:54,553 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:54,555 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112844a92fe7de8b4d0baba6de0d7d962c0e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112844a92fe7de8b4d0baba6de0d7d962c0e 2023-11-28 14:54:54,556 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112860ca1dbabd534a42b7b153f180af54d6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112860ca1dbabd534a42b7b153f180af54d6 2023-11-28 14:54:54,556 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-28 14:54:54,556 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231128' 2023-11-28 14:54:54,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231128 for table='testGetAfterCompaction' and column='f1' 2023-11-28 14:54:54,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-28 14:54:54,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:54:54,558 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-28 14:54:54,558 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): 16ddac28e3fab0e123c6fd68fba87190#f1#compaction#75 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:54:54,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 890 msec 2023-11-28 14:54:54,564 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,564 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:54,564 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,568 DEBUG [Listener at localhost/45519] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-28 14:54:54,572 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-28 14:54:54,572 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41403] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:54,573 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-28 14:54:54,573 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-28 14:54:54,573 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41403] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-28 14:54:54,573 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41403] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. because compaction request was cancelled 2023-11-28 14:54:54,624 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,624 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:54,624 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,675 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,675 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:54,675 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,726 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,726 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:54,726 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,777 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,777 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:54,777 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,828 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,828 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:54,828 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,879 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,879 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:54,879 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,930 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,930 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:54,930 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,980 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:54,981 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:54,981 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,031 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,032 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:55,032 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,082 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,082 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:55,082 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,133 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,133 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:55,133 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,184 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,184 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:55,184 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,235 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,235 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:55,235 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,286 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,286 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:55,286 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,337 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,337 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:55,337 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,372 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/.tmp/f1/30b5ff6d87c647c0bc9aa62eeec23510 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/30b5ff6d87c647c0bc9aa62eeec23510 2023-11-28 14:54:55,376 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 16ddac28e3fab0e123c6fd68fba87190/f1 of 16ddac28e3fab0e123c6fd68fba87190 into 30b5ff6d87c647c0bc9aa62eeec23510(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:54:55,376 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 16ddac28e3fab0e123c6fd68fba87190: 2023-11-28 14:54:55,377 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1701183294550; duration=0sec 2023-11-28 14:54:55,377 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:54:55,387 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/30b5ff6d87c647c0bc9aa62eeec23510; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701183295367; access_time=1701183294555; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,388 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,388 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:55,388 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,438 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/30b5ff6d87c647c0bc9aa62eeec23510; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701183295367; access_time=1701183294555; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,439 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,439 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701183294498; access_time=1701183293688; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-28 14:54:55,439 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183293656; access_time=1701183292840; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_] to archive 2023-11-28 14:54:55,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:54:55,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/f7b0dac2c8af45c3b747ff3c6500c112 2023-11-28 14:54:55,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/c87578206b724e1198934ef2a45e5650_SeqId_12_ 2023-11-28 14:54:55,489 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/30b5ff6d87c647c0bc9aa62eeec23510; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701183295367; access_time=1701183294555; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,489 INFO [Listener at localhost/45519] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701183292824; access_time=1701183292008; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-28 14:54:55,607 INFO [Listener at localhost/45519] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-28 14:54:55,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-28 14:54:55,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-28 14:54:55,623 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183295623"}]},"ts":"1701183295623"} 2023-11-28 14:54:55,625 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-28 14:54:55,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-28 14:54:55,626 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-28 14:54:55,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=16ddac28e3fab0e123c6fd68fba87190, UNASSIGN}] 2023-11-28 14:54:55,630 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=16ddac28e3fab0e123c6fd68fba87190, UNASSIGN 2023-11-28 14:54:55,630 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=16ddac28e3fab0e123c6fd68fba87190, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:55,630 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701183295630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183295630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183295630"}]},"ts":"1701183295630"} 2023-11-28 14:54:55,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 16ddac28e3fab0e123c6fd68fba87190, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:55,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-28 14:54:55,783 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:55,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:55,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 16ddac28e3fab0e123c6fd68fba87190, disabling compactions & flushes 2023-11-28 14:54:55,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:55,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:55,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. after waiting 0 ms 2023-11-28 14:54:55,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:55,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-28 14:54:55,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-28 14:54:55,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190. 2023-11-28 14:54:55,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 16ddac28e3fab0e123c6fd68fba87190: 2023-11-28 14:54:55,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:55,791 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=16ddac28e3fab0e123c6fd68fba87190, regionState=CLOSED 2023-11-28 14:54:55,791 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701183295791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183295791"}]},"ts":"1701183295791"} 2023-11-28 14:54:55,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=77, resume processing ppid=76 2023-11-28 14:54:55,794 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 16ddac28e3fab0e123c6fd68fba87190, server=jenkins-hbase4.apache.org,41403,1701183201531 in 160 msec 2023-11-28 14:54:55,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=76, resume processing ppid=75 2023-11-28 14:54:55,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=16ddac28e3fab0e123c6fd68fba87190, UNASSIGN in 166 msec 2023-11-28 14:54:55,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183295795"}]},"ts":"1701183295795"} 2023-11-28 14:54:55,796 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-28 14:54:55,799 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-28 14:54:55,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 185 msec 2023-11-28 14:54:55,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-28 14:54:55,927 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-28 14:54:55,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-28 14:54:55,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-28 14:54:55,941 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-28 14:54:55,942 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-28 14:54:55,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-28 14:54:55,945 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:55,946 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1, FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/recovered.edits] 2023-11-28 14:54:55,950 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/30b5ff6d87c647c0bc9aa62eeec23510 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/30b5ff6d87c647c0bc9aa62eeec23510 2023-11-28 14:54:55,951 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/f1/b42de8996d484ee78534bb768a4b9293 2023-11-28 14:54:55,953 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/recovered.edits/15.seqid to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190/recovered.edits/15.seqid 2023-11-28 14:54:55,954 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testGetAfterCompaction/16ddac28e3fab0e123c6fd68fba87190 2023-11-28 14:54:55,954 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-28 14:54:55,955 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-28 14:54:55,956 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-28 14:54:55,960 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231128dcc5431426f34fa6bf792d0eca61d380 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231128dcc5431426f34fa6bf792d0eca61d380 2023-11-28 14:54:55,960 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-28 14:54:55,963 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-28 14:54:55,994 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-28 14:54:55,997 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-28 14:54:55,998 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-28 14:54:55,998 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-28 14:54:55,999 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701183295998"}]},"ts":"9223372036854775807"} 2023-11-28 14:54:56,000 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-28 14:54:56,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 16ddac28e3fab0e123c6fd68fba87190, NAME => 'testGetAfterCompaction,,1701183289887.16ddac28e3fab0e123c6fd68fba87190.', STARTKEY => '', ENDKEY => ''}] 2023-11-28 14:54:56,000 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-28 14:54:56,001 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1701183296001"}]},"ts":"9223372036854775807"} 2023-11-28 14:54:56,002 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-28 14:54:56,004 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-28 14:54:56,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 70 msec 2023-11-28 14:54:56,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-28 14:54:56,045 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-28 14:54:56,064 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239 (was 258), OpenFileDescriptor=631 (was 685), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 172), ProcessCount=171 (was 172), AvailableMemoryMB=7636 (was 7654) 2023-11-28 14:54:56,080 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=631, MaxFileDescriptor=60000, SystemLoadAverage=161, ProcessCount=171, AvailableMemoryMB=7635 2023-11-28 14:54:56,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-28 14:54:56,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-28 14:54:56,087 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:54:56,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-28 14:54:56,087 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:54:56,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-28 14:54:56,090 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,090 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,090 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,092 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1 empty. 2023-11-28 14:54:56,092 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9 empty. 2023-11-28 14:54:56,092 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a empty. 2023-11-28 14:54:56,093 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,093 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,093 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,093 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-28 14:54:56,104 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-28 14:54:56,106 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 6fb4f2fcb12d20bd93bd596633c6e1d9, NAME => 'testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:56,106 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => f72347106c868af4e8e3936f91e9251a, NAME => 'testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:56,106 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7ba6d0f18a6921527c5bcad98b88e9c1, NAME => 'testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:54:56,124 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:56,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 7ba6d0f18a6921527c5bcad98b88e9c1, disabling compactions & flushes 2023-11-28 14:54:56,125 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:56,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:56,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. after waiting 0 ms 2023-11-28 14:54:56,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:56,125 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:56,125 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:54:56,126 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:56,126 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 6fb4f2fcb12d20bd93bd596633c6e1d9, disabling compactions & flushes 2023-11-28 14:54:56,126 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:56,126 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:56,126 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. after waiting 0 ms 2023-11-28 14:54:56,126 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:56,126 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:56,126 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:54:56,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-28 14:54:56,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-28 14:54:56,524 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:56,524 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing f72347106c868af4e8e3936f91e9251a, disabling compactions & flushes 2023-11-28 14:54:56,524 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:56,524 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:56,524 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. after waiting 0 ms 2023-11-28 14:54:56,524 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:56,524 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:56,524 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:54:56,526 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:54:56,527 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183296527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183296527"}]},"ts":"1701183296527"} 2023-11-28 14:54:56,528 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183296527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183296527"}]},"ts":"1701183296527"} 2023-11-28 14:54:56,528 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183296527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183296527"}]},"ts":"1701183296527"} 2023-11-28 14:54:56,529 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-28 14:54:56,530 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:54:56,530 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183296530"}]},"ts":"1701183296530"} 2023-11-28 14:54:56,531 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-28 14:54:56,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, ASSIGN}] 2023-11-28 14:54:56,538 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, ASSIGN 2023-11-28 14:54:56,538 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, ASSIGN 2023-11-28 14:54:56,538 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, ASSIGN 2023-11-28 14:54:56,538 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:56,538 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:56,538 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:54:56,690 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f72347106c868af4e8e3936f91e9251a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:56,690 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=6fb4f2fcb12d20bd93bd596633c6e1d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:56,690 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=7ba6d0f18a6921527c5bcad98b88e9c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:56,690 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183296690"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183296690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183296690"}]},"ts":"1701183296690"} 2023-11-28 14:54:56,690 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183296690"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183296690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183296690"}]},"ts":"1701183296690"} 2023-11-28 14:54:56,690 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183296690"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183296690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183296690"}]},"ts":"1701183296690"} 2023-11-28 14:54:56,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-28 14:54:56,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 7ba6d0f18a6921527c5bcad98b88e9c1, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:56,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure 6fb4f2fcb12d20bd93bd596633c6e1d9, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:56,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure f72347106c868af4e8e3936f91e9251a, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:54:56,844 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:56,847 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:56,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ba6d0f18a6921527c5bcad98b88e9c1, NAME => 'testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.', STARTKEY => '', ENDKEY => '1'} 2023-11-28 14:54:56,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:56,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,849 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,850 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1 2023-11-28 14:54:56,851 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1 2023-11-28 14:54:56,851 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ba6d0f18a6921527c5bcad98b88e9c1 columnFamilyName family1 2023-11-28 14:54:56,852 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(310): Store=7ba6d0f18a6921527c5bcad98b88e9c1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:56,852 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,853 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2 2023-11-28 14:54:56,853 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2 2023-11-28 14:54:56,854 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ba6d0f18a6921527c5bcad98b88e9c1 columnFamilyName family2 2023-11-28 14:54:56,855 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(310): Store=7ba6d0f18a6921527c5bcad98b88e9c1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:56,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:54:56,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:54:56,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:56,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ba6d0f18a6921527c5bcad98b88e9c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72955007, jitterRate=0.08711431920528412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:54:56,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:54:56,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1., pid=83, masterSystemTime=1701183296844 2023-11-28 14:54:56,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:56,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:56,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:56,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f72347106c868af4e8e3936f91e9251a, NAME => 'testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.', STARTKEY => '1', ENDKEY => '2'} 2023-11-28 14:54:56,864 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=7ba6d0f18a6921527c5bcad98b88e9c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:56,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,864 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183296864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183296864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183296864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183296864"}]},"ts":"1701183296864"} 2023-11-28 14:54:56,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:56,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,865 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,866 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1 2023-11-28 14:54:56,866 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1 2023-11-28 14:54:56,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=83, resume processing ppid=80 2023-11-28 14:54:56,867 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f72347106c868af4e8e3936f91e9251a columnFamilyName family1 2023-11-28 14:54:56,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 7ba6d0f18a6921527c5bcad98b88e9c1, server=jenkins-hbase4.apache.org,41403,1701183201531 in 173 msec 2023-11-28 14:54:56,868 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(310): Store=f72347106c868af4e8e3936f91e9251a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:56,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, ASSIGN in 333 msec 2023-11-28 14:54:56,868 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,869 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2 2023-11-28 14:54:56,869 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2 2023-11-28 14:54:56,869 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f72347106c868af4e8e3936f91e9251a columnFamilyName family2 2023-11-28 14:54:56,870 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(310): Store=f72347106c868af4e8e3936f91e9251a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:56,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:54:56,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f72347106c868af4e8e3936f91e9251a 2023-11-28 14:54:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:56,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f72347106c868af4e8e3936f91e9251a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63496024, jitterRate=-0.053835511207580566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:54:56,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:54:56,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a., pid=85, masterSystemTime=1701183296844 2023-11-28 14:54:56,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:56,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:56,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:56,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6fb4f2fcb12d20bd93bd596633c6e1d9, NAME => 'testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.', STARTKEY => '2', ENDKEY => ''} 2023-11-28 14:54:56,880 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f72347106c868af4e8e3936f91e9251a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:56,881 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183296880"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183296880"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183296880"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183296880"}]},"ts":"1701183296880"} 2023-11-28 14:54:56,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:54:56,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,882 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=85, resume processing ppid=81 2023-11-28 14:54:56,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure f72347106c868af4e8e3936f91e9251a, server=jenkins-hbase4.apache.org,41403,1701183201531 in 189 msec 2023-11-28 14:54:56,884 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1 2023-11-28 14:54:56,884 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1 2023-11-28 14:54:56,885 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fb4f2fcb12d20bd93bd596633c6e1d9 columnFamilyName family1 2023-11-28 14:54:56,885 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, ASSIGN in 350 msec 2023-11-28 14:54:56,886 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(310): Store=6fb4f2fcb12d20bd93bd596633c6e1d9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:56,886 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,888 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2 2023-11-28 14:54:56,888 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2 2023-11-28 14:54:56,888 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fb4f2fcb12d20bd93bd596633c6e1d9 columnFamilyName family2 2023-11-28 14:54:56,889 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(310): Store=6fb4f2fcb12d20bd93bd596633c6e1d9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:54:56,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:54:56,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:54:56,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:54:56,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6fb4f2fcb12d20bd93bd596633c6e1d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67839834, jitterRate=0.010892301797866821}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:54:56,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:54:56,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9., pid=84, masterSystemTime=1701183296844 2023-11-28 14:54:56,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:56,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:56,900 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=6fb4f2fcb12d20bd93bd596633c6e1d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:56,900 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183296900"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183296900"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183296900"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183296900"}]},"ts":"1701183296900"} 2023-11-28 14:54:56,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=84, resume processing ppid=82 2023-11-28 14:54:56,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure 6fb4f2fcb12d20bd93bd596633c6e1d9, server=jenkins-hbase4.apache.org,41403,1701183201531 in 210 msec 2023-11-28 14:54:56,905 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=82, resume processing ppid=79 2023-11-28 14:54:56,905 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, ASSIGN in 367 msec 2023-11-28 14:54:56,905 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:54:56,906 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183296906"}]},"ts":"1701183296906"} 2023-11-28 14:54:56,907 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-28 14:54:56,910 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:54:56,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 827 msec 2023-11-28 14:54:57,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-28 14:54:57,192 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-28 14:54:57,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:54:57,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:54:57,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:54:57,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:57,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-28 14:54:57,205 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-28 14:54:57,206 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:57,206 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-28 14:54:57,206 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-28 14:54:57,206 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:57,206 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:54:57,208 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:57,208 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:57,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:57,208 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:57,208 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:54:57,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:54:57,209 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-28 14:54:57,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-28 14:54:57,209 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-28 14:54:57,209 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:57,209 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-28 14:54:57,209 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:57,209 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. started... 2023-11-28 14:54:57,210 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:57,210 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. started... 2023-11-28 14:54:57,210 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7ba6d0f18a6921527c5bcad98b88e9c1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-28 14:54:57,210 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:54:57,211 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6fb4f2fcb12d20bd93bd596633c6e1d9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-28 14:54:57,210 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:57,211 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:57,211 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. started... 2023-11-28 14:54:57,211 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f72347106c868af4e8e3936f91e9251a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-28 14:54:57,637 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112832f9f3d811b04807b25d327e5edb752d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112832f9f3d811b04807b25d327e5edb752d 2023-11-28 14:54:57,637 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311287fb488e9c44f45a5813b81bda08d958a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311287fb488e9c44f45a5813b81bda08d958a 2023-11-28 14:54:57,637 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128702ca0454d9647cf84d9055c8a1cc0af to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128702ca0454d9647cf84d9055c8a1cc0af 2023-11-28 14:54:57,645 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/2cd99042f36149caabebd0ccb4740459 2023-11-28 14:54:58,043 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/86f8f9c43e264c7f8c93f54140e9de58 2023-11-28 14:54:58,043 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d 2023-11-28 14:54:58,060 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128b62db7689b58496d936445d621bed1e9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128b62db7689b58496d936445d621bed1e9 2023-11-28 14:54:58,061 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112860c31d6c072e4e8e85b1e6a600e70b23 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112860c31d6c072e4e8e85b1e6a600e70b23 2023-11-28 14:54:58,066 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/b0e63793b0c24f3f8250fda725aa60c1 2023-11-28 14:54:58,067 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/e13329c32b8a412e9e0b9ced0189f0cb 2023-11-28 14:54:58,070 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/2cd99042f36149caabebd0ccb4740459 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/2cd99042f36149caabebd0ccb4740459 2023-11-28 14:54:58,071 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d 2023-11-28 14:54:58,075 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/2cd99042f36149caabebd0ccb4740459, entries=4, sequenceid=5, filesize=5.4 K 2023-11-28 14:54:58,075 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d, entries=4, sequenceid=5, filesize=5.4 K 2023-11-28 14:54:58,076 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/b0e63793b0c24f3f8250fda725aa60c1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b0e63793b0c24f3f8250fda725aa60c1 2023-11-28 14:54:58,076 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/e13329c32b8a412e9e0b9ced0189f0cb as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/e13329c32b8a412e9e0b9ced0189f0cb 2023-11-28 14:54:58,080 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b0e63793b0c24f3f8250fda725aa60c1, entries=2, sequenceid=5, filesize=5.1 K 2023-11-28 14:54:58,080 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/e13329c32b8a412e9e0b9ced0189f0cb, entries=2, sequenceid=5, filesize=5.1 K 2023-11-28 14:54:58,081 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6fb4f2fcb12d20bd93bd596633c6e1d9 in 870ms, sequenceid=5, compaction requested=false 2023-11-28 14:54:58,081 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-28 14:54:58,081 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f72347106c868af4e8e3936f91e9251a in 870ms, sequenceid=5, compaction requested=false 2023-11-28 14:54:58,081 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-28 14:54:58,081 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:54:58,082 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:54:58,082 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:58,082 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:58,082 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:54:58,082 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:54:58,461 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311282ca4c0b909e34f4fb884d355ced3ac8e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311282ca4c0b909e34f4fb884d355ced3ac8e 2023-11-28 14:54:58,866 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/571a03a1fa15461fa456c1c11ae55eae 2023-11-28 14:54:58,871 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/86f8f9c43e264c7f8c93f54140e9de58 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/86f8f9c43e264c7f8c93f54140e9de58 2023-11-28 14:54:58,875 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/86f8f9c43e264c7f8c93f54140e9de58, entries=4, sequenceid=5, filesize=5.4 K 2023-11-28 14:54:58,876 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/571a03a1fa15461fa456c1c11ae55eae as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/571a03a1fa15461fa456c1c11ae55eae 2023-11-28 14:54:58,881 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/571a03a1fa15461fa456c1c11ae55eae, entries=2, sequenceid=5, filesize=5.1 K 2023-11-28 14:54:58,881 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7ba6d0f18a6921527c5bcad98b88e9c1 in 1671ms, sequenceid=5, compaction requested=false 2023-11-28 14:54:58,882 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:54:58,882 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:58,882 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:54:58,882 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:54:58,882 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,882 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-28 14:54:58,882 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-28 14:54:58,884 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:54:58,884 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:58,884 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:54:58,884 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:54:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:54:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:58,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-28 14:54:58,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2975fc43[Count = 0] remaining members to acquire global barrier 2023-11-28 14:54:58,886 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-28 14:54:58,886 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:54:58,887 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:54:58,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:54:58,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:54:58,887 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-28 14:54:58,887 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-28 14:54:58,887 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:54:58,887 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,887 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:54:58,896 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-28 14:54:58,896 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,896 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:58,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:58,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:58,896 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-28 14:54:58,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:58,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:54:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:54:58,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:54:58,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-28 14:54:58,898 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-28 14:54:58,898 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:54:58,898 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:54:58,898 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-28 14:54:58,898 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:54:58,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:58,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:54:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:54:58,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:58,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:54:58,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:58,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:58,900 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:58,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:54:58,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:54:58,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:54:58,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:54:58,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:54:58,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:58,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:54:58,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:54:58,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:58,905 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:54:58,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:58,905 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:54:58,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-28 14:54:58,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:54:58,905 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:58,905 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:54:58,905 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:54:58,905 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:58,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:54:58,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:54:58,905 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-28 14:54:58,905 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:54:59,005 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:54:59,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:54:59,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:54:59,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:54:59,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:54:59,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:54:59,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-28 14:54:59,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-28 14:54:59,013 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-28 14:54:59,013 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:59,013 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-28 14:54:59,013 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-28 14:54:59,013 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:59,013 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:54:59,015 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:59,015 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:54:59,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:54:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:54:59,015 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:54:59,015 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:54:59,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:54:59,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:54:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:54:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:54:59,016 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-28 14:54:59,016 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-28 14:54:59,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-28 14:54:59,017 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-28 14:54:59,017 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:54:59,017 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-28 14:54:59,017 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:59,017 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. started... 2023-11-28 14:54:59,017 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7ba6d0f18a6921527c5bcad98b88e9c1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-28 14:54:59,018 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:54:59,018 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:54:59,018 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:59,018 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:54:59,018 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. started... 2023-11-28 14:54:59,018 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. started... 2023-11-28 14:54:59,018 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6fb4f2fcb12d20bd93bd596633c6e1d9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-28 14:54:59,018 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f72347106c868af4e8e3936f91e9251a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-28 14:54:59,442 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128f34bd11440044f6fb9f678a721137e3e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231128f34bd11440044f6fb9f678a721137e3e 2023-11-28 14:54:59,448 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112822da9a95b3fd4b8788db3dd8b30af9c1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112822da9a95b3fd4b8788db3dd8b30af9c1 2023-11-28 14:54:59,448 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112837207a5eab47444e9e023dfcb74fbbb7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112837207a5eab47444e9e023dfcb74fbbb7 2023-11-28 14:54:59,453 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/88699d8d9fbf49cea36cd94bcc5aa6af 2023-11-28 14:54:59,465 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311286ae94aba91854d298c3f1dab3f8e29e4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311286ae94aba91854d298c3f1dab3f8e29e4 2023-11-28 14:54:59,469 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/c3358d9dc58147108a1db3e9be545892 2023-11-28 14:54:59,472 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/88699d8d9fbf49cea36cd94bcc5aa6af as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/88699d8d9fbf49cea36cd94bcc5aa6af 2023-11-28 14:54:59,475 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/88699d8d9fbf49cea36cd94bcc5aa6af, entries=4, sequenceid=9, filesize=5.4 K 2023-11-28 14:54:59,476 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/c3358d9dc58147108a1db3e9be545892 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/c3358d9dc58147108a1db3e9be545892 2023-11-28 14:54:59,479 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/c3358d9dc58147108a1db3e9be545892, entries=2, sequenceid=9, filesize=5.1 K 2023-11-28 14:54:59,480 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f72347106c868af4e8e3936f91e9251a in 462ms, sequenceid=9, compaction requested=false 2023-11-28 14:54:59,480 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:54:59,480 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:54:59,480 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:54:59,848 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/ed0f29a61eac42c98406ee1f64fcbbde 2023-11-28 14:54:59,855 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/9512074c56dc4bf69491f3d7d15233f7 2023-11-28 14:54:59,863 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128eb3623f3739b4911b4c3d3a5b1487843 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128eb3623f3739b4911b4c3d3a5b1487843 2023-11-28 14:54:59,868 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/4e0de66b24804ee4911b24bb97a39a2d 2023-11-28 14:54:59,871 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/ed0f29a61eac42c98406ee1f64fcbbde as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/ed0f29a61eac42c98406ee1f64fcbbde 2023-11-28 14:54:59,874 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/ed0f29a61eac42c98406ee1f64fcbbde, entries=4, sequenceid=9, filesize=5.4 K 2023-11-28 14:54:59,875 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/4e0de66b24804ee4911b24bb97a39a2d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/4e0de66b24804ee4911b24bb97a39a2d 2023-11-28 14:54:59,878 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/4e0de66b24804ee4911b24bb97a39a2d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-28 14:54:59,879 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7ba6d0f18a6921527c5bcad98b88e9c1 in 862ms, sequenceid=9, compaction requested=false 2023-11-28 14:54:59,879 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:54:59,879 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:54:59,879 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:00,269 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128a730a2f0ef2b4c4cbab670cdcccdf000 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128a730a2f0ef2b4c4cbab670cdcccdf000 2023-11-28 14:55:00,675 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/b613348235f34f1584916b1a5c973cb9 2023-11-28 14:55:00,679 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/9512074c56dc4bf69491f3d7d15233f7 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/9512074c56dc4bf69491f3d7d15233f7 2023-11-28 14:55:00,682 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/9512074c56dc4bf69491f3d7d15233f7, entries=4, sequenceid=9, filesize=5.4 K 2023-11-28 14:55:00,683 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/b613348235f34f1584916b1a5c973cb9 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b613348235f34f1584916b1a5c973cb9 2023-11-28 14:55:00,687 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b613348235f34f1584916b1a5c973cb9, entries=2, sequenceid=9, filesize=5.1 K 2023-11-28 14:55:00,687 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6fb4f2fcb12d20bd93bd596633c6e1d9 in 1669ms, sequenceid=9, compaction requested=false 2023-11-28 14:55:00,687 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:00,688 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:00,688 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:00,688 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:00,688 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,688 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-28 14:55:00,688 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-28 14:55:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:00,693 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:00,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-28 14:55:00,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e8e452e[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:00,695 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-28 14:55:00,695 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:00,696 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:00,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:00,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:00,696 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-28 14:55:00,696 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-28 14:55:00,696 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:00,696 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,696 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:00,698 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-28 14:55:00,698 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:00,698 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,698 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-28 14:55:00,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:00,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:00,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:00,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:00,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:00,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:00,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:00,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:00,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-28 14:55:00,700 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-28 14:55:00,700 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:00,700 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:00,700 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-28 14:55:00,700 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:00,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:00,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:00,702 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:00,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:00,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:00,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:00,703 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:00,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:00,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:00,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,704 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:00,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:00,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,707 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,707 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:00,707 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:00,707 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:00,707 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:00,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-28 14:55:00,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:00,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:00,707 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:00,707 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:00,707 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:00,708 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:00,708 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:00,708 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:00,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:00,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:00,708 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:00,808 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:00,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:00,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:00,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:00,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:00,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:00,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:00,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-28 14:55:00,816 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-28 14:55:00,816 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:00,816 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-28 14:55:00,816 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-28 14:55:00,816 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:00,816 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:00,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:00,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:00,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:00,819 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:00,819 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:00,819 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:00,819 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-28 14:55:00,820 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-28 14:55:00,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-28 14:55:00,820 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-28 14:55:00,820 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:00,820 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-28 14:55:00,820 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:00,820 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. started... 2023-11-28 14:55:00,820 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:00,820 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:00,820 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7ba6d0f18a6921527c5bcad98b88e9c1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-28 14:55:00,820 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:00,820 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:00,820 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. started... 2023-11-28 14:55:00,820 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. started... 2023-11-28 14:55:00,821 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f72347106c868af4e8e3936f91e9251a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-28 14:55:00,821 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6fb4f2fcb12d20bd93bd596633c6e1d9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-28 14:55:00,854 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128633ef54bc20a43ddad245222948d9cd8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128633ef54bc20a43ddad245222948d9cd8 2023-11-28 14:55:01,252 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112842324a4769954b86aefd59ae25aca623 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112842324a4769954b86aefd59ae25aca623 2023-11-28 14:55:01,252 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311289adfc7c26f1c4619a7371a15ad894feb to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311289adfc7c26f1c4619a7371a15ad894feb 2023-11-28 14:55:01,260 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/5e64e81070aa4037b8b03ca75c99277b 2023-11-28 14:55:01,290 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:55:01,660 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/6bdce13974cd485dbfda90c7545311e2 2023-11-28 14:55:01,660 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/b50f25d4ef6e41909bb781c70deb3e98 2023-11-28 14:55:01,675 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112840c8a787618c4a50a7808c83b3e8a7b1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112840c8a787618c4a50a7808c83b3e8a7b1 2023-11-28 14:55:02,078 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128f46170de32a54b54b91967dcad75acdc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128f46170de32a54b54b91967dcad75acdc 2023-11-28 14:55:02,078 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112848cecd4d8fdf494381ce8f5a974ef4cb to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112848cecd4d8fdf494381ce8f5a974ef4cb 2023-11-28 14:55:02,080 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/68ffb2a003114c65b9b641afda3559d9 2023-11-28 14:55:02,084 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/b7af3b671f964a838aca1c9b3feb9651 2023-11-28 14:55:02,085 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/39da9cf59b134f42953ccfd90d928be0 2023-11-28 14:55:02,086 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/5e64e81070aa4037b8b03ca75c99277b as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/5e64e81070aa4037b8b03ca75c99277b 2023-11-28 14:55:02,089 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/b50f25d4ef6e41909bb781c70deb3e98 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/b50f25d4ef6e41909bb781c70deb3e98 2023-11-28 14:55:02,090 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/6bdce13974cd485dbfda90c7545311e2 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/6bdce13974cd485dbfda90c7545311e2 2023-11-28 14:55:02,091 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/5e64e81070aa4037b8b03ca75c99277b, entries=4, sequenceid=13, filesize=5.4 K 2023-11-28 14:55:02,092 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/68ffb2a003114c65b9b641afda3559d9 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/68ffb2a003114c65b9b641afda3559d9 2023-11-28 14:55:02,093 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/b50f25d4ef6e41909bb781c70deb3e98, entries=4, sequenceid=13, filesize=5.4 K 2023-11-28 14:55:02,094 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/b7af3b671f964a838aca1c9b3feb9651 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/b7af3b671f964a838aca1c9b3feb9651 2023-11-28 14:55:02,095 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/6bdce13974cd485dbfda90c7545311e2, entries=4, sequenceid=13, filesize=5.4 K 2023-11-28 14:55:02,096 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/39da9cf59b134f42953ccfd90d928be0 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/39da9cf59b134f42953ccfd90d928be0 2023-11-28 14:55:02,096 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/68ffb2a003114c65b9b641afda3559d9, entries=2, sequenceid=13, filesize=5.1 K 2023-11-28 14:55:02,097 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6fb4f2fcb12d20bd93bd596633c6e1d9 in 1276ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:02,097 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:02,097 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:02,097 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:02,099 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/b7af3b671f964a838aca1c9b3feb9651, entries=2, sequenceid=13, filesize=5.1 K 2023-11-28 14:55:02,099 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/39da9cf59b134f42953ccfd90d928be0, entries=2, sequenceid=13, filesize=5.1 K 2023-11-28 14:55:02,099 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7ba6d0f18a6921527c5bcad98b88e9c1 in 1279ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:02,100 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:02,100 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:02,100 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f72347106c868af4e8e3936f91e9251a in 1279ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:02,100 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:02,100 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-28 14:55:02,100 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-28 14:55:02,102 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:02,102 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:02,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-28 14:55:02,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c4557ba[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:02,104 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-28 14:55:02,104 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:02,105 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:02,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:02,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:02,105 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-28 14:55:02,105 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-28 14:55:02,105 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:02,105 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,105 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:02,107 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-28 14:55:02,107 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,107 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:02,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:02,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:02,107 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-28 14:55:02,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:02,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:02,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:02,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:02,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:02,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:02,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-28 14:55:02,110 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-28 14:55:02,110 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:02,110 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:02,110 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-28 14:55:02,110 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:02,111 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:02,111 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:02,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:02,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:02,111 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:02,112 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:02,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:02,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,113 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:02,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:02,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:02,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:02,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-28 14:55:02,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:02,116 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:02,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:02,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:02,116 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:02,217 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:02,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:02,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:02,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:02,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:02,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:02,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:02,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-28 14:55:02,224 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-28 14:55:02,224 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:02,224 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-28 14:55:02,224 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-28 14:55:02,224 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:02,224 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:02,226 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,226 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:02,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:02,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:02,226 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:02,226 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:02,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:02,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:02,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:02,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:02,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-28 14:55:02,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-28 14:55:02,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-28 14:55:02,227 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-28 14:55:02,227 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:02,227 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-28 14:55:02,230 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:02,230 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. started... 2023-11-28 14:55:02,230 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:02,230 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:02,230 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7ba6d0f18a6921527c5bcad98b88e9c1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-28 14:55:02,230 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:02,230 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:02,230 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. started... 2023-11-28 14:55:02,230 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. started... 2023-11-28 14:55:02,230 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f72347106c868af4e8e3936f91e9251a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-28 14:55:02,230 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6fb4f2fcb12d20bd93bd596633c6e1d9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-28 14:55:02,647 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112869c7d2b147a44cd58a0b72254a0e28d5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112869c7d2b147a44cd58a0b72254a0e28d5 2023-11-28 14:55:02,647 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311281d6cdee687c2494d91ed22ebd7850f58 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311281d6cdee687c2494d91ed22ebd7850f58 2023-11-28 14:55:02,648 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128544e53e43dc0434d9d1112bf9076067e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128544e53e43dc0434d9d1112bf9076067e 2023-11-28 14:55:03,055 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/9907c6de2a964f3791331df51d33a275 2023-11-28 14:55:03,057 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/bc03fd33d4e24fba84aff3b7f85973df 2023-11-28 14:55:03,058 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/81e8ab6b909e440a8f5a060a1f8ce10e 2023-11-28 14:55:03,485 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311289c0b93b51b0b44b6967a24576b3b1745 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311289c0b93b51b0b44b6967a24576b3b1745 2023-11-28 14:55:03,486 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311285f4d57ac3fc24d2e931c5ed033406f2e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311285f4d57ac3fc24d2e931c5ed033406f2e 2023-11-28 14:55:03,486 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311283662a30a63604feba194db7dda81b9f6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311283662a30a63604feba194db7dda81b9f6 2023-11-28 14:55:03,891 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/859742d0bba7441980ea01b482239d4a 2023-11-28 14:55:03,891 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/82a39b75f91e4111a962c07a9e5bb881 2023-11-28 14:55:03,891 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/aca82a017ed646d79a47ce4e0bbdcbe3 2023-11-28 14:55:03,896 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/bc03fd33d4e24fba84aff3b7f85973df as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/bc03fd33d4e24fba84aff3b7f85973df 2023-11-28 14:55:03,896 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/81e8ab6b909e440a8f5a060a1f8ce10e as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/81e8ab6b909e440a8f5a060a1f8ce10e 2023-11-28 14:55:03,896 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/9907c6de2a964f3791331df51d33a275 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9907c6de2a964f3791331df51d33a275 2023-11-28 14:55:03,900 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/81e8ab6b909e440a8f5a060a1f8ce10e, entries=4, sequenceid=17, filesize=5.4 K 2023-11-28 14:55:03,900 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/bc03fd33d4e24fba84aff3b7f85973df, entries=4, sequenceid=17, filesize=5.4 K 2023-11-28 14:55:03,900 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9907c6de2a964f3791331df51d33a275, entries=4, sequenceid=17, filesize=5.4 K 2023-11-28 14:55:03,901 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/aca82a017ed646d79a47ce4e0bbdcbe3 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/aca82a017ed646d79a47ce4e0bbdcbe3 2023-11-28 14:55:03,901 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/82a39b75f91e4111a962c07a9e5bb881 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/82a39b75f91e4111a962c07a9e5bb881 2023-11-28 14:55:03,901 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/859742d0bba7441980ea01b482239d4a as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/859742d0bba7441980ea01b482239d4a 2023-11-28 14:55:03,907 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/aca82a017ed646d79a47ce4e0bbdcbe3, entries=2, sequenceid=17, filesize=5.1 K 2023-11-28 14:55:03,907 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/82a39b75f91e4111a962c07a9e5bb881, entries=2, sequenceid=17, filesize=5.1 K 2023-11-28 14:55:03,908 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/859742d0bba7441980ea01b482239d4a, entries=2, sequenceid=17, filesize=5.1 K 2023-11-28 14:55:03,908 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7ba6d0f18a6921527c5bcad98b88e9c1 in 1678ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:03,908 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f72347106c868af4e8e3936f91e9251a in 1678ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:03,908 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:03,908 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:03,908 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:03,908 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:03,908 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:03,908 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6fb4f2fcb12d20bd93bd596633c6e1d9 in 1678ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:03,908 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:03,909 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:03,909 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:03,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:03,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:03,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-28 14:55:03,909 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-28 14:55:03,912 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,912 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:03,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:03,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:03,912 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:03,912 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:03,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:03,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:03,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:03,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:03,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-28 14:55:03,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30cce709[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:03,914 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-28 14:55:03,914 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:03,916 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,916 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:03,917 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:03,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:03,917 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-28 14:55:03,917 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-28 14:55:03,917 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:03,919 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-28 14:55:03,919 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:03,919 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,919 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-28 14:55:03,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:03,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:03,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:03,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:03,921 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-28 14:55:03,921 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:03,921 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:03,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-28 14:55:03,921 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-28 14:55:03,921 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:03,923 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:03,923 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:03,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:03,923 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:03,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:03,923 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,925 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,928 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,928 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:03,928 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:03,928 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:03,928 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:03,928 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:03,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-28 14:55:03,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-28 14:55:03,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:03,928 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:03,928 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:03,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:03,928 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:03,929 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:03,929 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:03,929 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:03,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:04,029 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:04,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:04,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-28 14:55:04,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1701183304041 (current time:1701183304041). 2023-11-28 14:55:04,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-28 14:55:04,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] zookeeper.ReadOnlyZKClient(139): Connect 0x09c81a3c to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:55:04,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ca8f1b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:55:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:55:04,057 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:55:04,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09c81a3c to 127.0.0.1:62725 2023-11-28 14:55:04,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:55:04,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-28 14:55:04,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-28 14:55:04,071 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot, current working dir path: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/snaptb-1701183304030 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-28 14:55:04,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-28 14:55:04,080 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-28 14:55:04,081 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1701183904081 2023-11-28 14:55:04,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-28 14:55:04,081 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1701183304030 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-28 14:55:04,082 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-28 14:55:04,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-28 14:55:04,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-11-28 14:55:04,084 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-28 14:55:04,085 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1701183904085 2023-11-28 14:55:04,087 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:04,087 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-28 14:55:04,188 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-28 14:55:04,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-28 14:55:04,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-28 14:55:04,192 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-28 14:55:04,392 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-28 14:55:04,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-28 14:55:04,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-28 14:55:04,393 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-28 14:55:04,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1701183304030 2023-11-28 14:55:04,492 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1701183304030' 2023-11-28 14:55:04,492 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-28 14:55:04,492 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1701183304030' starting 'acquire' 2023-11-28 14:55:04,492 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1701183304030', kicking off acquire phase on members. 2023-11-28 14:55:04,493 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1701183304030 2023-11-28 14:55:04,493 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1701183304030 2023-11-28 14:55:04,494 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-28 14:55:04,494 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-28 14:55:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-28 14:55:04,495 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,495 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:04,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1701183304030 2023-11-28 14:55:04,495 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1701183304030 2023-11-28 14:55:04,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-28 14:55:04,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1701183304030 2023-11-28 14:55:04,496 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1701183304030 from table testCompactionWithHFileLink type FLUSH 2023-11-28 14:55:04,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1701183304030 2023-11-28 14:55:04,500 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1701183304030' with timeout 300000ms 2023-11-28 14:55:04,500 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-28 14:55:04,500 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1701183304030' starting 'acquire' stage 2023-11-28 14:55:04,500 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1701183304030' locally acquired 2023-11-28 14:55:04,500 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (snaptb-1701183304030) in zk 2023-11-28 14:55:04,502 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,502 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1701183304030 2023-11-28 14:55:04,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:04,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-28 14:55:04,502 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1701183304030 2023-11-28 14:55:04,502 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1701183304030' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:04,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:04,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:04,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701183304030 2023-11-28 14:55:04,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:04,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'snaptb-1701183304030' on coordinator 2023-11-28 14:55:04,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@365d92b7[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:04,503 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1701183304030' starting 'in-barrier' execution. 2023-11-28 14:55:04,503 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1701183304030 2023-11-28 14:55:04,505 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701183304030 2023-11-28 14:55:04,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1701183304030 2023-11-28 14:55:04,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1701183304030 2023-11-28 14:55:04,505 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1701183304030' received 'reached' from coordinator. 2023-11-28 14:55:04,505 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,505 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:04,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:04,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-28 14:55:04,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-28 14:55:04,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. started... 2023-11-28 14:55:04,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. started... 2023-11-28 14:55:04,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. started... 2023-11-28 14:55:04,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:04,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:04,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:04,508 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.' region-info for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,508 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.' region-info for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,508 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.' region-info for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,513 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-28 14:55:04,513 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-28 14:55:04,513 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-28 14:55:04,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/88699d8d9fbf49cea36cd94bcc5aa6af, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/6bdce13974cd485dbfda90c7545311e2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/81e8ab6b909e440a8f5a060a1f8ce10e] hfiles 2023-11-28 14:55:04,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/86f8f9c43e264c7f8c93f54140e9de58, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/ed0f29a61eac42c98406ee1f64fcbbde, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/b50f25d4ef6e41909bb781c70deb3e98, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9907c6de2a964f3791331df51d33a275] hfiles 2023-11-28 14:55:04,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/2cd99042f36149caabebd0ccb4740459, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/9512074c56dc4bf69491f3d7d15233f7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/5e64e81070aa4037b8b03ca75c99277b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/bc03fd33d4e24fba84aff3b7f85973df] hfiles 2023-11-28 14:55:04,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/86f8f9c43e264c7f8c93f54140e9de58 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,517 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/2cd99042f36149caabebd0ccb4740459 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/ed0f29a61eac42c98406ee1f64fcbbde for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/9512074c56dc4bf69491f3d7d15233f7 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/88699d8d9fbf49cea36cd94bcc5aa6af for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/5e64e81070aa4037b8b03ca75c99277b for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/6bdce13974cd485dbfda90c7545311e2 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/b50f25d4ef6e41909bb781c70deb3e98 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/81e8ab6b909e440a8f5a060a1f8ce10e for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/bc03fd33d4e24fba84aff3b7f85973df for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9907c6de2a964f3791331df51d33a275 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b0e63793b0c24f3f8250fda725aa60c1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b613348235f34f1584916b1a5c973cb9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/68ffb2a003114c65b9b641afda3559d9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/859742d0bba7441980ea01b482239d4a] hfiles 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/e13329c32b8a412e9e0b9ced0189f0cb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/c3358d9dc58147108a1db3e9be545892, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/39da9cf59b134f42953ccfd90d928be0, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/aca82a017ed646d79a47ce4e0bbdcbe3] hfiles 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/e13329c32b8a412e9e0b9ced0189f0cb for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/571a03a1fa15461fa456c1c11ae55eae, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/4e0de66b24804ee4911b24bb97a39a2d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/b7af3b671f964a838aca1c9b3feb9651, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/82a39b75f91e4111a962c07a9e5bb881] hfiles 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/c3358d9dc58147108a1db3e9be545892 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b0e63793b0c24f3f8250fda725aa60c1 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/39da9cf59b134f42953ccfd90d928be0 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/571a03a1fa15461fa456c1c11ae55eae for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/aca82a017ed646d79a47ce4e0bbdcbe3 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/4e0de66b24804ee4911b24bb97a39a2d for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b613348235f34f1584916b1a5c973cb9 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/b7af3b671f964a838aca1c9b3feb9651 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,521 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/68ffb2a003114c65b9b641afda3559d9 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,521 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/82a39b75f91e4111a962c07a9e5bb881 for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,521 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/859742d0bba7441980ea01b482239d4a for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,693 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-28 14:55:04,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-28 14:55:04,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-28 14:55:04,694 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-28 14:55:04,927 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. completed. 2023-11-28 14:55:04,927 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. completed. 2023-11-28 14:55:04,927 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:04,927 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:04,927 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. completed. 2023-11-28 14:55:04,927 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-28 14:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-28 14:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-28 14:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-28 14:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1701183304030' locally completed 2023-11-28 14:55:04,928 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1701183304030' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:04,931 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1701183304030' has notified controller of completion 2023-11-28 14:55:04,931 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:04,931 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,931 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1701183304030' completed. 2023-11-28 14:55:04,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:04,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-28 14:55:04,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:04,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:04,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701183304030 2023-11-28 14:55:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701183304030 2023-11-28 14:55:04,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1701183304030' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:04,934 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'snaptb-1701183304030', counting down latch. Waiting for 0 more 2023-11-28 14:55:04,934 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1701183304030' execution completed 2023-11-28 14:55:04,934 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:04,934 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:04,934 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1701183304030 2023-11-28 14:55:04,934 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1701183304030including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-28 14:55:04,937 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701183304030 2023-11-28 14:55:04,937 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-28 14:55:04,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1701183304030 2023-11-28 14:55:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1701183304030 2023-11-28 14:55:04,937 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701183304030 2023-11-28 14:55:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1701183304030 2023-11-28 14:55:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-28 14:55:04,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-28 14:55:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-28 14:55:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:04,938 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1701183304030 2023-11-28 14:55:04,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701183304030 2023-11-28 14:55:04,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:04,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701183304030 2023-11-28 14:55:04,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,939 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:04,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701183304030 2023-11-28 14:55:04,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,942 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,942 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701183304030 2023-11-28 14:55:04,942 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701183304030 2023-11-28 14:55:04,942 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701183304030/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:04,942 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701183304030 2023-11-28 14:55:04,942 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-28 14:55:04,942 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:04,942 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701183304030 2023-11-28 14:55:04,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-28 14:55:04,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1701183304030 2023-11-28 14:55:04,942 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-28 14:55:04,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-28 14:55:04,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-28 14:55:04,942 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701183304030 2023-11-28 14:55:04,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1701183304030 2023-11-28 14:55:04,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-28 14:55:04,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-28 14:55:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112837207a5eab47444e9e023dfcb74fbbb7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112842324a4769954b86aefd59ae25aca623, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112869c7d2b147a44cd58a0b72254a0e28d5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311287fb488e9c44f45a5813b81bda08d958a, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112822da9a95b3fd4b8788db3dd8b30af9c1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128544e53e43dc0434d9d1112bf9076067e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128633ef54bc20a43ddad245222948d9cd8, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128702ca0454d9647cf84d9055c8a1cc0af, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311281d6cdee687c2494d91ed22ebd7850f58, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112832f9f3d811b04807b25d327e5edb752d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311289adfc7c26f1c4619a7371a15ad894feb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231128f34bd11440044f6fb9f678a721137e3e] mob files 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112837207a5eab47444e9e023dfcb74fbbb7 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112842324a4769954b86aefd59ae25aca623 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112869c7d2b147a44cd58a0b72254a0e28d5 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311287fb488e9c44f45a5813b81bda08d958a 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112822da9a95b3fd4b8788db3dd8b30af9c1 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128544e53e43dc0434d9d1112bf9076067e 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128633ef54bc20a43ddad245222948d9cd8 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128702ca0454d9647cf84d9055c8a1cc0af 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311281d6cdee687c2494d91ed22ebd7850f58 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112832f9f3d811b04807b25d327e5edb752d 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311289adfc7c26f1c4619a7371a15ad894feb 2023-11-28 14:55:04,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231128f34bd11440044f6fb9f678a721137e3e 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311283662a30a63604feba194db7dda81b9f6, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112848cecd4d8fdf494381ce8f5a974ef4cb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112860c31d6c072e4e8e85b1e6a600e70b23, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311286ae94aba91854d298c3f1dab3f8e29e4, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112840c8a787618c4a50a7808c83b3e8a7b1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311285f4d57ac3fc24d2e931c5ed033406f2e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128a730a2f0ef2b4c4cbab670cdcccdf000, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128b62db7689b58496d936445d621bed1e9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311282ca4c0b909e34f4fb884d355ced3ac8e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311289c0b93b51b0b44b6967a24576b3b1745, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128eb3623f3739b4911b4c3d3a5b1487843, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128f46170de32a54b54b91967dcad75acdc] mob files 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311283662a30a63604feba194db7dda81b9f6 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112848cecd4d8fdf494381ce8f5a974ef4cb 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112860c31d6c072e4e8e85b1e6a600e70b23 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311286ae94aba91854d298c3f1dab3f8e29e4 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112840c8a787618c4a50a7808c83b3e8a7b1 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311285f4d57ac3fc24d2e931c5ed033406f2e 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128a730a2f0ef2b4c4cbab670cdcccdf000 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128b62db7689b58496d936445d621bed1e9 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311282ca4c0b909e34f4fb884d355ced3ac8e 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311289c0b93b51b0b44b6967a24576b3b1745 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128eb3623f3739b4911b4c3d3a5b1487843 2023-11-28 14:55:04,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128f46170de32a54b54b91967dcad75acdc 2023-11-28 14:55:05,194 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-28 14:55:05,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-28 14:55:05,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-28 14:55:05,195 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-28 14:55:05,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1701183304030 2023-11-28 14:55:05,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/snaptb-1701183304030 2023-11-28 14:55:05,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/snaptb-1701183304030 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/snaptb-1701183304030 2023-11-28 14:55:05,802 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1701183304030 of table testCompactionWithHFileLink completed 2023-11-28 14:55:05,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/snaptb-1701183304030 2023-11-28 14:55:05,803 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/snaptb-1701183304030 2023-11-28 14:55:05,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1701183304030 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1701183304081Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1701183305352 (+1271 ms)Consolidate snapshot: snaptb-1701183304030 at 1701183305352Loading Region manifests for snaptb-1701183304030 at 1701183305352Writing data manifest for snaptb-1701183304030 at 1701183305365 (+13 ms)Verifying snapshot: snaptb-1701183304030 at 1701183305773 (+408 ms)Snapshot snaptb-1701183304030 of table testCompactionWithHFileLink completed at 1701183305802 (+29 ms) 2023-11-28 14:55:05,804 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-28 14:55:05,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7210 sec 2023-11-28 14:55:06,196 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-28 14:55:06,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-28 14:55:06,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-28 14:55:06,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:06,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:06,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-28 14:55:06,233 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-28 14:55:06,233 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:06,233 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-28 14:55:06,233 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-28 14:55:06,234 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:06,234 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:06,235 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:06,235 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:06,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:06,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:06,236 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:06,236 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:06,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:06,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:06,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:06,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:06,237 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-28 14:55:06,237 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-28 14:55:06,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-28 14:55:06,237 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-28 14:55:06,237 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:06,237 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-28 14:55:06,238 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:06,238 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:06,239 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:06,239 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:06,239 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. started... 2023-11-28 14:55:06,239 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:06,239 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. started... 2023-11-28 14:55:06,239 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7ba6d0f18a6921527c5bcad98b88e9c1 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-28 14:55:06,239 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. started... 2023-11-28 14:55:06,239 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 6fb4f2fcb12d20bd93bd596633c6e1d9 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-28 14:55:06,239 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f72347106c868af4e8e3936f91e9251a 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-28 14:55:06,270 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/fb23554225da4a8db2b6924a3291d264 2023-11-28 14:55:06,274 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb23554225da4a8db2b6924a3291d264 2023-11-28 14:55:06,668 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/37de9aa57f6744c993e470ff69c72377 2023-11-28 14:55:06,671 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37de9aa57f6744c993e470ff69c72377 2023-11-28 14:55:07,069 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/4b020db56a2a4d47a50f6a798281a203 2023-11-28 14:55:07,072 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b020db56a2a4d47a50f6a798281a203 2023-11-28 14:55:07,090 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/4c171b11621d49eeb92be247742a009d 2023-11-28 14:55:07,094 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c171b11621d49eeb92be247742a009d 2023-11-28 14:55:07,094 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/fb23554225da4a8db2b6924a3291d264 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/fb23554225da4a8db2b6924a3291d264 2023-11-28 14:55:07,097 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb23554225da4a8db2b6924a3291d264 2023-11-28 14:55:07,098 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/fb23554225da4a8db2b6924a3291d264, entries=3, sequenceid=24, filesize=5.0 K 2023-11-28 14:55:07,098 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/4c171b11621d49eeb92be247742a009d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/4c171b11621d49eeb92be247742a009d 2023-11-28 14:55:07,102 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c171b11621d49eeb92be247742a009d 2023-11-28 14:55:07,103 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/4c171b11621d49eeb92be247742a009d, entries=1, sequenceid=24, filesize=5.0 K 2023-11-28 14:55:07,103 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f72347106c868af4e8e3936f91e9251a in 864ms, sequenceid=24, compaction requested=true 2023-11-28 14:55:07,103 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:07,104 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:07,104 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:07,482 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/e35f393a052945298498b1b0df242279 2023-11-28 14:55:07,486 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e35f393a052945298498b1b0df242279 2023-11-28 14:55:07,487 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/37de9aa57f6744c993e470ff69c72377 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/37de9aa57f6744c993e470ff69c72377 2023-11-28 14:55:07,491 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37de9aa57f6744c993e470ff69c72377 2023-11-28 14:55:07,491 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/37de9aa57f6744c993e470ff69c72377, entries=3, sequenceid=24, filesize=5.0 K 2023-11-28 14:55:07,492 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/e35f393a052945298498b1b0df242279 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/e35f393a052945298498b1b0df242279 2023-11-28 14:55:07,495 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e35f393a052945298498b1b0df242279 2023-11-28 14:55:07,495 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/e35f393a052945298498b1b0df242279, entries=1, sequenceid=24, filesize=5.0 K 2023-11-28 14:55:07,496 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7ba6d0f18a6921527c5bcad98b88e9c1 in 1257ms, sequenceid=24, compaction requested=true 2023-11-28 14:55:07,496 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:07,496 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:07,496 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:07,885 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/d58123fa002949f28ef89e9bf6d99bda 2023-11-28 14:55:07,889 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d58123fa002949f28ef89e9bf6d99bda 2023-11-28 14:55:07,890 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/4b020db56a2a4d47a50f6a798281a203 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/4b020db56a2a4d47a50f6a798281a203 2023-11-28 14:55:07,893 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b020db56a2a4d47a50f6a798281a203 2023-11-28 14:55:07,893 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/4b020db56a2a4d47a50f6a798281a203, entries=3, sequenceid=24, filesize=5.0 K 2023-11-28 14:55:07,894 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/d58123fa002949f28ef89e9bf6d99bda as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/d58123fa002949f28ef89e9bf6d99bda 2023-11-28 14:55:07,897 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d58123fa002949f28ef89e9bf6d99bda 2023-11-28 14:55:07,897 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/d58123fa002949f28ef89e9bf6d99bda, entries=1, sequenceid=24, filesize=5.0 K 2023-11-28 14:55:07,898 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6fb4f2fcb12d20bd93bd596633c6e1d9 in 1659ms, sequenceid=24, compaction requested=true 2023-11-28 14:55:07,898 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:07,898 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:07,898 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:07,898 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:07,898 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,898 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-28 14:55:07,898 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-28 14:55:07,901 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,901 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:07,901 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:07,901 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:07,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-28 14:55:07,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a460667[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:07,903 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-28 14:55:07,903 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:07,904 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:07,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:07,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:07,904 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-28 14:55:07,904 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-28 14:55:07,904 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:07,904 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,904 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:07,905 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-28 14:55:07,905 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:07,905 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,905 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-28 14:55:07,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:07,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:07,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:07,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-28 14:55:07,908 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-28 14:55:07,908 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:07,908 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:07,908 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-28 14:55:07,908 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:07,910 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:07,910 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:07,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:07,910 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:07,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:07,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:07,911 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:07,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:07,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:07,912 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-28 14:55:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:07,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-28 14:55:07,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:07,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:07,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-28 14:55:07,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-28 14:55:07,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:07,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:07,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:07,920 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:07,920 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:07,921 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-28 14:55:07,921 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:07,921 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-28 14:55:07,921 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:07,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:07,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:08,021 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:08,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:08,023 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:08,023 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 7ba6d0f18a6921527c5bcad98b88e9c1/family1 is initiating major compaction (all files) 2023-11-28 14:55:08,023 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:08,023 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:08,023 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 7ba6d0f18a6921527c5bcad98b88e9c1/family1 in testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:08,023 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/86f8f9c43e264c7f8c93f54140e9de58, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/ed0f29a61eac42c98406ee1f64fcbbde, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/b50f25d4ef6e41909bb781c70deb3e98, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9907c6de2a964f3791331df51d33a275, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/37de9aa57f6744c993e470ff69c72377] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp, totalSize=26.7 K 2023-11-28 14:55:08,024 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 86f8f9c43e264c7f8c93f54140e9de58, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297199 2023-11-28 14:55:08,024 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting ed0f29a61eac42c98406ee1f64fcbbde, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299007 2023-11-28 14:55:08,025 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting b50f25d4ef6e41909bb781c70deb3e98, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300810 2023-11-28 14:55:08,025 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 9907c6de2a964f3791331df51d33a275, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302218 2023-11-28 14:55:08,025 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 37de9aa57f6744c993e470ff69c72377, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-28 14:55:08,038 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 7ba6d0f18a6921527c5bcad98b88e9c1#family1#compaction#106 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:08,050 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311286518e3be2f5840f9b0e060a49cc438fa_del 2023-11-28 14:55:08,050 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311286518e3be2f5840f9b0e060a49cc438fa_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311286518e3be2f5840f9b0e060a49cc438fa_del 2023-11-28 14:55:08,866 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b0e03c15c9548c094b16f17654ce087 2023-11-28 14:55:08,867 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/8b0e03c15c9548c094b16f17654ce087 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/8b0e03c15c9548c094b16f17654ce087 2023-11-28 14:55:08,870 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b0e03c15c9548c094b16f17654ce087 2023-11-28 14:55:08,871 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7ba6d0f18a6921527c5bcad98b88e9c1/family1 of 7ba6d0f18a6921527c5bcad98b88e9c1 into 8b0e03c15c9548c094b16f17654ce087(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:08,871 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:08,872 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:08,872 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 7ba6d0f18a6921527c5bcad98b88e9c1/family2 is initiating major compaction (all files) 2023-11-28 14:55:08,872 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:08,872 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:08,872 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 7ba6d0f18a6921527c5bcad98b88e9c1/family2 in testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:08,872 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/571a03a1fa15461fa456c1c11ae55eae, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/4e0de66b24804ee4911b24bb97a39a2d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/b7af3b671f964a838aca1c9b3feb9651, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/82a39b75f91e4111a962c07a9e5bb881, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/e35f393a052945298498b1b0df242279] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp, totalSize=25.4 K 2023-11-28 14:55:08,872 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 571a03a1fa15461fa456c1c11ae55eae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297199 2023-11-28 14:55:08,873 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 4e0de66b24804ee4911b24bb97a39a2d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299007 2023-11-28 14:55:08,873 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting b7af3b671f964a838aca1c9b3feb9651, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300810 2023-11-28 14:55:08,874 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 82a39b75f91e4111a962c07a9e5bb881, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302218 2023-11-28 14:55:08,874 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting e35f393a052945298498b1b0df242279, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-28 14:55:08,885 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 7ba6d0f18a6921527c5bcad98b88e9c1#family2#compaction#107 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:08,892 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231128ab7b2878ee7b463a8d50404531d8c3e6_del 2023-11-28 14:55:08,892 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128ab7b2878ee7b463a8d50404531d8c3e6_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128ab7b2878ee7b463a8d50404531d8c3e6_del 2023-11-28 14:55:08,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/86f8f9c43e264c7f8c93f54140e9de58, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/ed0f29a61eac42c98406ee1f64fcbbde, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/b50f25d4ef6e41909bb781c70deb3e98, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9907c6de2a964f3791331df51d33a275, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/37de9aa57f6744c993e470ff69c72377] to archive 2023-11-28 14:55:08,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:08,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/86f8f9c43e264c7f8c93f54140e9de58 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/86f8f9c43e264c7f8c93f54140e9de58 2023-11-28 14:55:08,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/ed0f29a61eac42c98406ee1f64fcbbde to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/ed0f29a61eac42c98406ee1f64fcbbde 2023-11-28 14:55:08,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/b50f25d4ef6e41909bb781c70deb3e98 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/b50f25d4ef6e41909bb781c70deb3e98 2023-11-28 14:55:08,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9907c6de2a964f3791331df51d33a275 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9907c6de2a964f3791331df51d33a275 2023-11-28 14:55:08,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/37de9aa57f6744c993e470ff69c72377 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/37de9aa57f6744c993e470ff69c72377 2023-11-28 14:55:09,708 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8c6bf78881c45188785e313de156f77 2023-11-28 14:55:09,709 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/a8c6bf78881c45188785e313de156f77 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/a8c6bf78881c45188785e313de156f77 2023-11-28 14:55:09,713 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8c6bf78881c45188785e313de156f77 2023-11-28 14:55:09,713 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7ba6d0f18a6921527c5bcad98b88e9c1/family2 of 7ba6d0f18a6921527c5bcad98b88e9c1 into a8c6bf78881c45188785e313de156f77(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:09,714 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:09,714 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:09,714 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 is initiating major compaction (all files) 2023-11-28 14:55:09,714 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:09,714 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:09,715 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 in testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:09,715 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/2cd99042f36149caabebd0ccb4740459, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/9512074c56dc4bf69491f3d7d15233f7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/5e64e81070aa4037b8b03ca75c99277b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/bc03fd33d4e24fba84aff3b7f85973df, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/4b020db56a2a4d47a50f6a798281a203] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp, totalSize=26.7 K 2023-11-28 14:55:09,715 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 2cd99042f36149caabebd0ccb4740459, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297201 2023-11-28 14:55:09,715 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 9512074c56dc4bf69491f3d7d15233f7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299008 2023-11-28 14:55:09,716 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 5e64e81070aa4037b8b03ca75c99277b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300811 2023-11-28 14:55:09,716 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting bc03fd33d4e24fba84aff3b7f85973df, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302219 2023-11-28 14:55:09,716 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 4b020db56a2a4d47a50f6a798281a203, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-28 14:55:09,729 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 6fb4f2fcb12d20bd93bd596633c6e1d9#family1#compaction#108 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:09,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/571a03a1fa15461fa456c1c11ae55eae, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/4e0de66b24804ee4911b24bb97a39a2d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/b7af3b671f964a838aca1c9b3feb9651, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/82a39b75f91e4111a962c07a9e5bb881, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/e35f393a052945298498b1b0df242279] to archive 2023-11-28 14:55:09,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:09,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/571a03a1fa15461fa456c1c11ae55eae to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/571a03a1fa15461fa456c1c11ae55eae 2023-11-28 14:55:09,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/4e0de66b24804ee4911b24bb97a39a2d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/4e0de66b24804ee4911b24bb97a39a2d 2023-11-28 14:55:09,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/b7af3b671f964a838aca1c9b3feb9651 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/b7af3b671f964a838aca1c9b3feb9651 2023-11-28 14:55:09,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/82a39b75f91e4111a962c07a9e5bb881 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/82a39b75f91e4111a962c07a9e5bb881 2023-11-28 14:55:09,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/e35f393a052945298498b1b0df242279 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/e35f393a052945298498b1b0df242279 2023-11-28 14:55:10,143 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311288837e9e6c2c6439cb34873a503ef6329_del 2023-11-28 14:55:10,144 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311288837e9e6c2c6439cb34873a503ef6329_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311288837e9e6c2c6439cb34873a503ef6329_del 2023-11-28 14:55:10,958 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d87e168a1b74370aaa223d5586c3dad 2023-11-28 14:55:10,959 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/7d87e168a1b74370aaa223d5586c3dad as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/7d87e168a1b74370aaa223d5586c3dad 2023-11-28 14:55:10,963 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d87e168a1b74370aaa223d5586c3dad 2023-11-28 14:55:10,964 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 of 6fb4f2fcb12d20bd93bd596633c6e1d9 into 7d87e168a1b74370aaa223d5586c3dad(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:10,964 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:10,964 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:10,964 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 6fb4f2fcb12d20bd93bd596633c6e1d9/family2 is initiating major compaction (all files) 2023-11-28 14:55:10,964 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:10,964 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:10,965 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 6fb4f2fcb12d20bd93bd596633c6e1d9/family2 in testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:10,965 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b0e63793b0c24f3f8250fda725aa60c1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b613348235f34f1584916b1a5c973cb9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/68ffb2a003114c65b9b641afda3559d9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/859742d0bba7441980ea01b482239d4a, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/d58123fa002949f28ef89e9bf6d99bda] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp, totalSize=25.4 K 2023-11-28 14:55:10,965 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting b0e63793b0c24f3f8250fda725aa60c1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297201 2023-11-28 14:55:10,965 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting b613348235f34f1584916b1a5c973cb9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299008 2023-11-28 14:55:10,966 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 68ffb2a003114c65b9b641afda3559d9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300811 2023-11-28 14:55:10,966 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 859742d0bba7441980ea01b482239d4a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302219 2023-11-28 14:55:10,966 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting d58123fa002949f28ef89e9bf6d99bda, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-28 14:55:10,980 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 6fb4f2fcb12d20bd93bd596633c6e1d9#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:10,989 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231128ddc98b71d4044548adaa3ea7decd09e7_del 2023-11-28 14:55:10,989 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128ddc98b71d4044548adaa3ea7decd09e7_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128ddc98b71d4044548adaa3ea7decd09e7_del 2023-11-28 14:55:11,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/2cd99042f36149caabebd0ccb4740459, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/9512074c56dc4bf69491f3d7d15233f7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/5e64e81070aa4037b8b03ca75c99277b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/bc03fd33d4e24fba84aff3b7f85973df, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/4b020db56a2a4d47a50f6a798281a203] to archive 2023-11-28 14:55:11,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:11,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/2cd99042f36149caabebd0ccb4740459 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/2cd99042f36149caabebd0ccb4740459 2023-11-28 14:55:11,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/9512074c56dc4bf69491f3d7d15233f7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/9512074c56dc4bf69491f3d7d15233f7 2023-11-28 14:55:11,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/5e64e81070aa4037b8b03ca75c99277b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/5e64e81070aa4037b8b03ca75c99277b 2023-11-28 14:55:11,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/bc03fd33d4e24fba84aff3b7f85973df to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/bc03fd33d4e24fba84aff3b7f85973df 2023-11-28 14:55:11,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/4b020db56a2a4d47a50f6a798281a203 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/4b020db56a2a4d47a50f6a798281a203 2023-11-28 14:55:11,803 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c120b9b3750547d8be6275b94f0806ed 2023-11-28 14:55:11,804 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/c120b9b3750547d8be6275b94f0806ed as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/c120b9b3750547d8be6275b94f0806ed 2023-11-28 14:55:11,808 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c120b9b3750547d8be6275b94f0806ed 2023-11-28 14:55:11,809 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6fb4f2fcb12d20bd93bd596633c6e1d9/family2 of 6fb4f2fcb12d20bd93bd596633c6e1d9 into c120b9b3750547d8be6275b94f0806ed(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:11,809 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:11,809 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:11,809 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): f72347106c868af4e8e3936f91e9251a/family1 is initiating major compaction (all files) 2023-11-28 14:55:11,809 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:11,809 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:11,809 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of f72347106c868af4e8e3936f91e9251a/family1 in testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:11,809 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/88699d8d9fbf49cea36cd94bcc5aa6af, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/6bdce13974cd485dbfda90c7545311e2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/81e8ab6b909e440a8f5a060a1f8ce10e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/fb23554225da4a8db2b6924a3291d264] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp, totalSize=26.7 K 2023-11-28 14:55:11,810 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting a8a9ba5b6d1b4a97b8d2a655a04df66d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297200 2023-11-28 14:55:11,810 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 88699d8d9fbf49cea36cd94bcc5aa6af, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299007 2023-11-28 14:55:11,810 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 6bdce13974cd485dbfda90c7545311e2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300811 2023-11-28 14:55:11,811 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 81e8ab6b909e440a8f5a060a1f8ce10e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302219 2023-11-28 14:55:11,811 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting fb23554225da4a8db2b6924a3291d264, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-28 14:55:11,821 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): f72347106c868af4e8e3936f91e9251a#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:11,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b0e63793b0c24f3f8250fda725aa60c1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b613348235f34f1584916b1a5c973cb9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/68ffb2a003114c65b9b641afda3559d9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/859742d0bba7441980ea01b482239d4a, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/d58123fa002949f28ef89e9bf6d99bda] to archive 2023-11-28 14:55:11,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:11,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b0e63793b0c24f3f8250fda725aa60c1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b0e63793b0c24f3f8250fda725aa60c1 2023-11-28 14:55:11,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b613348235f34f1584916b1a5c973cb9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/b613348235f34f1584916b1a5c973cb9 2023-11-28 14:55:11,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/68ffb2a003114c65b9b641afda3559d9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/68ffb2a003114c65b9b641afda3559d9 2023-11-28 14:55:11,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/859742d0bba7441980ea01b482239d4a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/859742d0bba7441980ea01b482239d4a 2023-11-28 14:55:11,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/d58123fa002949f28ef89e9bf6d99bda to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/d58123fa002949f28ef89e9bf6d99bda 2023-11-28 14:55:12,231 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231128a8fba9666c2347f8a7aa059164d038bb_del 2023-11-28 14:55:12,231 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128a8fba9666c2347f8a7aa059164d038bb_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231128a8fba9666c2347f8a7aa059164d038bb_del 2023-11-28 14:55:13,045 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29b740755e8a481aa01e29c2ec85a132 2023-11-28 14:55:13,046 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/29b740755e8a481aa01e29c2ec85a132 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/29b740755e8a481aa01e29c2ec85a132 2023-11-28 14:55:13,050 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29b740755e8a481aa01e29c2ec85a132 2023-11-28 14:55:13,051 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f72347106c868af4e8e3936f91e9251a/family1 of f72347106c868af4e8e3936f91e9251a into 29b740755e8a481aa01e29c2ec85a132(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:13,051 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:13,051 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:13,051 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): f72347106c868af4e8e3936f91e9251a/family2 is initiating major compaction (all files) 2023-11-28 14:55:13,051 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:13,052 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:13,052 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of f72347106c868af4e8e3936f91e9251a/family2 in testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:13,052 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/e13329c32b8a412e9e0b9ced0189f0cb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/c3358d9dc58147108a1db3e9be545892, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/39da9cf59b134f42953ccfd90d928be0, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/aca82a017ed646d79a47ce4e0bbdcbe3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/4c171b11621d49eeb92be247742a009d] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp, totalSize=25.4 K 2023-11-28 14:55:13,052 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting e13329c32b8a412e9e0b9ced0189f0cb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297200 2023-11-28 14:55:13,053 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting c3358d9dc58147108a1db3e9be545892, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299007 2023-11-28 14:55:13,053 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 39da9cf59b134f42953ccfd90d928be0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300811 2023-11-28 14:55:13,054 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting aca82a017ed646d79a47ce4e0bbdcbe3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302219 2023-11-28 14:55:13,054 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 4c171b11621d49eeb92be247742a009d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-28 14:55:13,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/88699d8d9fbf49cea36cd94bcc5aa6af, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/6bdce13974cd485dbfda90c7545311e2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/81e8ab6b909e440a8f5a060a1f8ce10e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/fb23554225da4a8db2b6924a3291d264] to archive 2023-11-28 14:55:13,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:13,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/a8a9ba5b6d1b4a97b8d2a655a04df66d 2023-11-28 14:55:13,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/88699d8d9fbf49cea36cd94bcc5aa6af to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/88699d8d9fbf49cea36cd94bcc5aa6af 2023-11-28 14:55:13,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/6bdce13974cd485dbfda90c7545311e2 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/6bdce13974cd485dbfda90c7545311e2 2023-11-28 14:55:13,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/81e8ab6b909e440a8f5a060a1f8ce10e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/81e8ab6b909e440a8f5a060a1f8ce10e 2023-11-28 14:55:13,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/fb23554225da4a8db2b6924a3291d264 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/fb23554225da4a8db2b6924a3291d264 2023-11-28 14:55:13,070 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): f72347106c868af4e8e3936f91e9251a#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:13,481 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231128fdce9288f5c54bfb960491860285cee7_del 2023-11-28 14:55:13,482 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128fdce9288f5c54bfb960491860285cee7_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231128fdce9288f5c54bfb960491860285cee7_del 2023-11-28 14:55:13,495 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d1466e4b34c4152b807670f2c9f36df 2023-11-28 14:55:13,496 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/2d1466e4b34c4152b807670f2c9f36df as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/2d1466e4b34c4152b807670f2c9f36df 2023-11-28 14:55:13,500 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d1466e4b34c4152b807670f2c9f36df 2023-11-28 14:55:13,501 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f72347106c868af4e8e3936f91e9251a/family2 of f72347106c868af4e8e3936f91e9251a into 2d1466e4b34c4152b807670f2c9f36df(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:13,501 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:13,505 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:13,509 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:13,514 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:13,515 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:13,522 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-28 14:55:13,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/e13329c32b8a412e9e0b9ced0189f0cb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/c3358d9dc58147108a1db3e9be545892, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/39da9cf59b134f42953ccfd90d928be0, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/aca82a017ed646d79a47ce4e0bbdcbe3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/4c171b11621d49eeb92be247742a009d] to archive 2023-11-28 14:55:13,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:13,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/e13329c32b8a412e9e0b9ced0189f0cb to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/e13329c32b8a412e9e0b9ced0189f0cb 2023-11-28 14:55:13,558 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-28 14:55:13,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/c3358d9dc58147108a1db3e9be545892 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/c3358d9dc58147108a1db3e9be545892 2023-11-28 14:55:13,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/39da9cf59b134f42953ccfd90d928be0 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/39da9cf59b134f42953ccfd90d928be0 2023-11-28 14:55:13,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/aca82a017ed646d79a47ce4e0bbdcbe3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/aca82a017ed646d79a47ce4e0bbdcbe3 2023-11-28 14:55:13,562 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311286518e3be2f5840f9b0e060a49cc438fa_del 2023-11-28 14:55:13,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/4c171b11621d49eeb92be247742a009d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/4c171b11621d49eeb92be247742a009d 2023-11-28 14:55:13,566 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231128a8fba9666c2347f8a7aa059164d038bb_del 2023-11-28 14:55:13,571 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311288837e9e6c2c6439cb34873a503ef6329_del 2023-11-28 14:55:13,571 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:13,572 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(139): Connect 0x297558a3 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:55:13,579 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b2cec99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:55:13,579 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:13,580 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:13,580 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:13,663 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311282e89560c5e7d438ab97ea715e26d6b63 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311282e89560c5e7d438ab97ea715e26d6b63 2023-11-28 14:55:13,664 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:13,665 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311281b71483bcc784f28aa3b1e15b3e89510 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311281b71483bcc784f28aa3b1e15b3e89510 2023-11-28 14:55:13,665 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:13,681 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:55:13,684 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:55:13,690 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:55:13,692 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:55:13,702 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128/family1/3f68a71550344c8ea220145f60c62035 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-28 14:55:13,702 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128/family1/f3a3bd13e57548e0b1288813307b8366 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-28 14:55:13,703 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128/family1/3f68a71550344c8ea220145f60c62035}] 2023-11-28 14:55:13,704 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128/family1/f3a3bd13e57548e0b1288813307b8366}] 2023-11-28 14:55:13,707 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128/family1/3f68a71550344c8ea220145f60c62035 for inclusion in 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 2023-11-28 14:55:13,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128/family1/f3a3bd13e57548e0b1288813307b8366 for inclusion in 7ba6d0f18a6921527c5bcad98b88e9c1/family1 2023-11-28 14:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-28 14:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-28 14:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-28 14:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last=1 2023-11-28 14:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:13,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128/family1/3f68a71550344c8ea220145f60c62035 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__rm0p4dhtgjjup0gdltjij8lqj77tromnhcsodm79htkpd52otl2gb0i43jmrqusd/family1/3f68a71550344c8ea220145f60c62035 2023-11-28 14:55:13,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128/family1/f3a3bd13e57548e0b1288813307b8366 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__ejuqn40b76rinidmgl8n1beqfk2194s37if444iqmdu61666kqn2iumjhgfvi4oh/family1/f3a3bd13e57548e0b1288813307b8366 2023-11-28 14:55:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__rm0p4dhtgjjup0gdltjij8lqj77tromnhcsodm79htkpd52otl2gb0i43jmrqusd/family1/3f68a71550344c8ea220145f60c62035 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/ce9468481ca44f1caf98743e02cf81ae_SeqId_29_ 2023-11-28 14:55:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__ejuqn40b76rinidmgl8n1beqfk2194s37if444iqmdu61666kqn2iumjhgfvi4oh/family1/f3a3bd13e57548e0b1288813307b8366 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/477444ef40294b2f935783120f320171_SeqId_29_ 2023-11-28 14:55:13,713 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__rm0p4dhtgjjup0gdltjij8lqj77tromnhcsodm79htkpd52otl2gb0i43jmrqusd/family1/3f68a71550344c8ea220145f60c62035 into 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/ce9468481ca44f1caf98743e02cf81ae_SeqId_29_ - updating store file list. 2023-11-28 14:55:13,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__ejuqn40b76rinidmgl8n1beqfk2194s37if444iqmdu61666kqn2iumjhgfvi4oh/family1/f3a3bd13e57548e0b1288813307b8366 into 7ba6d0f18a6921527c5bcad98b88e9c1/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/477444ef40294b2f935783120f320171_SeqId_29_ - updating store file list. 2023-11-28 14:55:13,717 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/ce9468481ca44f1caf98743e02cf81ae_SeqId_29_ into 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 2023-11-28 14:55:13,718 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__rm0p4dhtgjjup0gdltjij8lqj77tromnhcsodm79htkpd52otl2gb0i43jmrqusd/family1/3f68a71550344c8ea220145f60c62035 into 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/ce9468481ca44f1caf98743e02cf81ae_SeqId_29_) 2023-11-28 14:55:13,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/477444ef40294b2f935783120f320171_SeqId_29_ into 7ba6d0f18a6921527c5bcad98b88e9c1/family1 2023-11-28 14:55:13,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__ejuqn40b76rinidmgl8n1beqfk2194s37if444iqmdu61666kqn2iumjhgfvi4oh/family1/f3a3bd13e57548e0b1288813307b8366 into 7ba6d0f18a6921527c5bcad98b88e9c1/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/477444ef40294b2f935783120f320171_SeqId_29_) 2023-11-28 14:55:13,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__rm0p4dhtgjjup0gdltjij8lqj77tromnhcsodm79htkpd52otl2gb0i43jmrqusd/family1/3f68a71550344c8ea220145f60c62035 2023-11-28 14:55:13,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__ejuqn40b76rinidmgl8n1beqfk2194s37if444iqmdu61666kqn2iumjhgfvi4oh/family1/f3a3bd13e57548e0b1288813307b8366 2023-11-28 14:55:13,720 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:13,720 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:13,721 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:13,721 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:13,722 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112822da9a95b3fd4b8788db3dd8b30af9c1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112822da9a95b3fd4b8788db3dd8b30af9c1 2023-11-28 14:55:13,722 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311281d6cdee687c2494d91ed22ebd7850f58 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311281d6cdee687c2494d91ed22ebd7850f58 2023-11-28 14:55:13,723 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128544e53e43dc0434d9d1112bf9076067e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128544e53e43dc0434d9d1112bf9076067e 2023-11-28 14:55:13,724 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112832f9f3d811b04807b25d327e5edb752d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112832f9f3d811b04807b25d327e5edb752d 2023-11-28 14:55:13,724 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128633ef54bc20a43ddad245222948d9cd8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128633ef54bc20a43ddad245222948d9cd8 2023-11-28 14:55:13,724 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311289adfc7c26f1c4619a7371a15ad894feb to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311289adfc7c26f1c4619a7371a15ad894feb 2023-11-28 14:55:13,725 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128702ca0454d9647cf84d9055c8a1cc0af to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231128702ca0454d9647cf84d9055c8a1cc0af 2023-11-28 14:55:13,726 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231128f34bd11440044f6fb9f678a721137e3e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231128f34bd11440044f6fb9f678a721137e3e 2023-11-28 14:55:13,726 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-28 14:55:13,726 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-28 14:55:13,726 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128' 2023-11-28 14:55:13,726 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128' 2023-11-28 14:55:13,726 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:13,726 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:14,465 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128858d0c8df35b48ce97b03c67d23b20e4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231128858d0c8df35b48ce97b03c67d23b20e4 2023-11-28 14:55:14,466 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:14,494 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128/family1/f02330f9eeba42e9a158a89845214f5c first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-28 14:55:14,495 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128/family1/f02330f9eeba42e9a158a89845214f5c}] 2023-11-28 14:55:14,496 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128/family1/f02330f9eeba42e9a158a89845214f5c for inclusion in f72347106c868af4e8e3936f91e9251a/family1 2023-11-28 14:55:14,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-28 14:55:14,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-28 14:55:14,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:14,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128/family1/f02330f9eeba42e9a158a89845214f5c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__pbbekvt1bbfj6rjdmda0pgqt5v519n5r191k8d19l1h8ce1vqabcfs3ph3hqdbd/family1/f02330f9eeba42e9a158a89845214f5c 2023-11-28 14:55:14,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__pbbekvt1bbfj6rjdmda0pgqt5v519n5r191k8d19l1h8ce1vqabcfs3ph3hqdbd/family1/f02330f9eeba42e9a158a89845214f5c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/ae6515b6238948a0b2cffd24050d9c73_SeqId_29_ 2023-11-28 14:55:14,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__pbbekvt1bbfj6rjdmda0pgqt5v519n5r191k8d19l1h8ce1vqabcfs3ph3hqdbd/family1/f02330f9eeba42e9a158a89845214f5c into f72347106c868af4e8e3936f91e9251a/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/ae6515b6238948a0b2cffd24050d9c73_SeqId_29_ - updating store file list. 2023-11-28 14:55:14,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/ae6515b6238948a0b2cffd24050d9c73_SeqId_29_ into f72347106c868af4e8e3936f91e9251a/family1 2023-11-28 14:55:14,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__pbbekvt1bbfj6rjdmda0pgqt5v519n5r191k8d19l1h8ce1vqabcfs3ph3hqdbd/family1/f02330f9eeba42e9a158a89845214f5c into f72347106c868af4e8e3936f91e9251a/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/ae6515b6238948a0b2cffd24050d9c73_SeqId_29_) 2023-11-28 14:55:14,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__pbbekvt1bbfj6rjdmda0pgqt5v519n5r191k8d19l1h8ce1vqabcfs3ph3hqdbd/family1/f02330f9eeba42e9a158a89845214f5c 2023-11-28 14:55:14,510 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:14,510 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:14,512 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112837207a5eab47444e9e023dfcb74fbbb7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112837207a5eab47444e9e023dfcb74fbbb7 2023-11-28 14:55:14,513 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112842324a4769954b86aefd59ae25aca623 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112842324a4769954b86aefd59ae25aca623 2023-11-28 14:55:14,514 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112869c7d2b147a44cd58a0b72254a0e28d5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023112869c7d2b147a44cd58a0b72254a0e28d5 2023-11-28 14:55:14,515 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311287fb488e9c44f45a5813b81bda08d958a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311287fb488e9c44f45a5813b81bda08d958a 2023-11-28 14:55:14,516 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-28 14:55:14,516 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128' 2023-11-28 14:55:14,516 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:14,516 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:14,516 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:14,516 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311286518e3be2f5840f9b0e060a49cc438fa_del] 2023-11-28 14:55:14,517 DEBUG [Listener at localhost/45519] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:14,518 DEBUG [Listener at localhost/45519] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311286518e3be2f5840f9b0e060a49cc438fa_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311286518e3be2f5840f9b0e060a49cc438fa_del 2023-11-28 14:55:14,519 INFO [Listener at localhost/45519] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-28 14:55:14,519 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231128a8fba9666c2347f8a7aa059164d038bb_del] 2023-11-28 14:55:14,519 DEBUG [Listener at localhost/45519] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:14,521 DEBUG [Listener at localhost/45519] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231128a8fba9666c2347f8a7aa059164d038bb_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231128a8fba9666c2347f8a7aa059164d038bb_del 2023-11-28 14:55:14,521 INFO [Listener at localhost/45519] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-28 14:55:14,521 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311288837e9e6c2c6439cb34873a503ef6329_del] 2023-11-28 14:55:14,521 DEBUG [Listener at localhost/45519] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:14,523 DEBUG [Listener at localhost/45519] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311288837e9e6c2c6439cb34873a503ef6329_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311288837e9e6c2c6439cb34873a503ef6329_del 2023-11-28 14:55:14,523 INFO [Listener at localhost/45519] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-28 14:55:14,526 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:14,528 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:14,532 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:14,533 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:14,540 INFO [Listener at localhost/45519] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-28 14:55:14,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-28 14:55:14,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-28 14:55:14,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-28 14:55:14,544 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183314544"}]},"ts":"1701183314544"} 2023-11-28 14:55:14,545 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-28 14:55:14,547 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-28 14:55:14,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, UNASSIGN}] 2023-11-28 14:55:14,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, UNASSIGN 2023-11-28 14:55:14,549 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, UNASSIGN 2023-11-28 14:55:14,549 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, UNASSIGN 2023-11-28 14:55:14,550 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=f72347106c868af4e8e3936f91e9251a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:14,550 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6fb4f2fcb12d20bd93bd596633c6e1d9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:14,550 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183314550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183314550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183314550"}]},"ts":"1701183314550"} 2023-11-28 14:55:14,550 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183314550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183314550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183314550"}]},"ts":"1701183314550"} 2023-11-28 14:55:14,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=7ba6d0f18a6921527c5bcad98b88e9c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:14,550 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183314550"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183314550"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183314550"}]},"ts":"1701183314550"} 2023-11-28 14:55:14,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure f72347106c868af4e8e3936f91e9251a, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:14,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 6fb4f2fcb12d20bd93bd596633c6e1d9, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:14,553 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 7ba6d0f18a6921527c5bcad98b88e9c1, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:14,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-28 14:55:14,703 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:14,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:14,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ba6d0f18a6921527c5bcad98b88e9c1, disabling compactions & flushes 2023-11-28 14:55:14,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:14,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:14,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. after waiting 0 ms 2023-11-28 14:55:14,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:14,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-28 14:55:14,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:14,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:14,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:14,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:14,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6fb4f2fcb12d20bd93bd596633c6e1d9, disabling compactions & flushes 2023-11-28 14:55:14,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. after waiting 0 ms 2023-11-28 14:55:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:14,711 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=7ba6d0f18a6921527c5bcad98b88e9c1, regionState=CLOSED 2023-11-28 14:55:14,711 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183314711"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183314711"}]},"ts":"1701183314711"} 2023-11-28 14:55:14,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=94, resume processing ppid=89 2023-11-28 14:55:14,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 7ba6d0f18a6921527c5bcad98b88e9c1, server=jenkins-hbase4.apache.org,41403,1701183201531 in 160 msec 2023-11-28 14:55:14,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-28 14:55:14,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:14,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:14,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, UNASSIGN in 166 msec 2023-11-28 14:55:14,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:14,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:14,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f72347106c868af4e8e3936f91e9251a, disabling compactions & flushes 2023-11-28 14:55:14,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:14,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:14,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. after waiting 0 ms 2023-11-28 14:55:14,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:14,717 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6fb4f2fcb12d20bd93bd596633c6e1d9, regionState=CLOSED 2023-11-28 14:55:14,717 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183314716"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183314716"}]},"ts":"1701183314716"} 2023-11-28 14:55:14,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=93, resume processing ppid=91 2023-11-28 14:55:14,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 6fb4f2fcb12d20bd93bd596633c6e1d9, server=jenkins-hbase4.apache.org,41403,1701183201531 in 166 msec 2023-11-28 14:55:14,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-28 14:55:14,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, UNASSIGN in 171 msec 2023-11-28 14:55:14,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:14,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:14,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:14,723 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=f72347106c868af4e8e3936f91e9251a, regionState=CLOSED 2023-11-28 14:55:14,723 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183314723"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183314723"}]},"ts":"1701183314723"} 2023-11-28 14:55:14,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=92, resume processing ppid=90 2023-11-28 14:55:14,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure f72347106c868af4e8e3936f91e9251a, server=jenkins-hbase4.apache.org,41403,1701183201531 in 173 msec 2023-11-28 14:55:14,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=90, resume processing ppid=88 2023-11-28 14:55:14,727 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, UNASSIGN in 177 msec 2023-11-28 14:55:14,727 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183314727"}]},"ts":"1701183314727"} 2023-11-28 14:55:14,728 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-28 14:55:14,730 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-28 14:55:14,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 190 msec 2023-11-28 14:55:14,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-28 14:55:14,846 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-28 14:55:14,857 INFO [Listener at localhost/45519] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1701183304030-1701183314857 2023-11-28 14:55:14,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-28 14:55:14,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1701183314857 (current time:1701183314857). 2023-11-28 14:55:14,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-28 14:55:14,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] zookeeper.ReadOnlyZKClient(139): Connect 0x3dba2e1b to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:55:14,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6076e383, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:55:14,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:55:14,865 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:55:14,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3dba2e1b to 127.0.0.1:62725 2023-11-28 14:55:14,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:55:14,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-28 14:55:14,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-28 14:55:14,870 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot, current working dir path: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701183304030-1701183314857 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-28 14:55:14,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-28 14:55:14,873 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-28 14:55:14,874 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1701183914874 2023-11-28 14:55:14,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-28 14:55:14,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1701183304030-1701183314857 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-28 14:55:14,874 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:14,874 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-28 14:55:14,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-28 14:55:14,886 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-28 14:55:14,886 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-28 14:55:14,886 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-28 14:55:14,886 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-28 14:55:14,886 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-28 14:55:14,886 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-28 14:55:14,886 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-28 14:55:14,886 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-28 14:55:14,890 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/29b740755e8a481aa01e29c2ec85a132, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/ae6515b6238948a0b2cffd24050d9c73_SeqId_29_] hfiles 2023-11-28 14:55:14,890 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/29b740755e8a481aa01e29c2ec85a132 2023-11-28 14:55:14,890 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/477444ef40294b2f935783120f320171_SeqId_29_, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/8b0e03c15c9548c094b16f17654ce087] hfiles 2023-11-28 14:55:14,890 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/ae6515b6238948a0b2cffd24050d9c73_SeqId_29_ 2023-11-28 14:55:14,890 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/477444ef40294b2f935783120f320171_SeqId_29_ 2023-11-28 14:55:14,890 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/8b0e03c15c9548c094b16f17654ce087 2023-11-28 14:55:14,891 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231128858d0c8df35b48ce97b03c67d23b20e4, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311281b71483bcc784f28aa3b1e15b3e89510, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311282e89560c5e7d438ab97ea715e26d6b63] hfiles 2023-11-28 14:55:14,891 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231128858d0c8df35b48ce97b03c67d23b20e4 2023-11-28 14:55:14,891 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311281b71483bcc784f28aa3b1e15b3e89510 2023-11-28 14:55:14,891 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311282e89560c5e7d438ab97ea715e26d6b63 2023-11-28 14:55:14,892 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/a8c6bf78881c45188785e313de156f77] hfiles 2023-11-28 14:55:14,892 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/a8c6bf78881c45188785e313de156f77 2023-11-28 14:55:14,892 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/7d87e168a1b74370aaa223d5586c3dad, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/ce9468481ca44f1caf98743e02cf81ae_SeqId_29_] hfiles 2023-11-28 14:55:14,892 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/7d87e168a1b74370aaa223d5586c3dad 2023-11-28 14:55:14,892 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/ce9468481ca44f1caf98743e02cf81ae_SeqId_29_ 2023-11-28 14:55:14,893 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/2d1466e4b34c4152b807670f2c9f36df] hfiles 2023-11-28 14:55:14,894 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/2d1466e4b34c4152b807670f2c9f36df 2023-11-28 14:55:14,894 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/c120b9b3750547d8be6275b94f0806ed] hfiles 2023-11-28 14:55:14,894 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/c120b9b3750547d8be6275b94f0806ed 2023-11-28 14:55:14,916 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311283662a30a63604feba194db7dda81b9f6, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112848cecd4d8fdf494381ce8f5a974ef4cb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112860c31d6c072e4e8e85b1e6a600e70b23, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311286ae94aba91854d298c3f1dab3f8e29e4, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231128fdce9288f5c54bfb960491860285cee7_del, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112840c8a787618c4a50a7808c83b3e8a7b1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311285f4d57ac3fc24d2e931c5ed033406f2e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128a730a2f0ef2b4c4cbab670cdcccdf000, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128b62db7689b58496d936445d621bed1e9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128ddc98b71d4044548adaa3ea7decd09e7_del, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311282ca4c0b909e34f4fb884d355ced3ac8e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311289c0b93b51b0b44b6967a24576b3b1745, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128ab7b2878ee7b463a8d50404531d8c3e6_del, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128eb3623f3739b4911b4c3d3a5b1487843, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128f46170de32a54b54b91967dcad75acdc] hfiles 2023-11-28 14:55:14,916 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311283662a30a63604feba194db7dda81b9f6 2023-11-28 14:55:14,916 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112848cecd4d8fdf494381ce8f5a974ef4cb 2023-11-28 14:55:14,916 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112860c31d6c072e4e8e85b1e6a600e70b23 2023-11-28 14:55:14,916 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311286ae94aba91854d298c3f1dab3f8e29e4 2023-11-28 14:55:14,916 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231128fdce9288f5c54bfb960491860285cee7_del 2023-11-28 14:55:14,916 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023112840c8a787618c4a50a7808c83b3e8a7b1 2023-11-28 14:55:14,916 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311285f4d57ac3fc24d2e931c5ed033406f2e 2023-11-28 14:55:14,917 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128a730a2f0ef2b4c4cbab670cdcccdf000 2023-11-28 14:55:14,917 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128b62db7689b58496d936445d621bed1e9 2023-11-28 14:55:14,917 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128ddc98b71d4044548adaa3ea7decd09e7_del 2023-11-28 14:55:14,917 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311282ca4c0b909e34f4fb884d355ced3ac8e 2023-11-28 14:55:14,917 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311289c0b93b51b0b44b6967a24576b3b1745 2023-11-28 14:55:14,917 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128ab7b2878ee7b463a8d50404531d8c3e6_del 2023-11-28 14:55:14,917 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128eb3623f3739b4911b4c3d3a5b1487843 2023-11-28 14:55:14,917 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128f46170de32a54b54b91967dcad75acdc 2023-11-28 14:55:14,974 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-28 14:55:14,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-28 14:55:14,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-28 14:55:14,976 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-28 14:55:15,176 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-28 14:55:15,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-28 14:55:15,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-28 14:55:15,178 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-28 14:55:15,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-28 14:55:15,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1701183304030-1701183314857 2023-11-28 14:55:15,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701183304030-1701183314857 2023-11-28 14:55:15,478 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-28 14:55:15,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-28 14:55:15,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-28 14:55:15,479 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-28 14:55:15,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701183304030-1701183314857 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/hbase-failsafe-snaptb-1701183304030-1701183314857 2023-11-28 14:55:15,751 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1701183304030-1701183314857 of table testCompactionWithHFileLink completed 2023-11-28 14:55:15,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701183304030-1701183314857 2023-11-28 14:55:15,751 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701183304030-1701183314857 2023-11-28 14:55:15,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1701183304030-1701183314857 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1701183314874Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1701183314882 (+8 ms)Consolidate snapshot: hbase-failsafe-snaptb-1701183304030-1701183314857 at 1701183315324 (+442 ms)Loading Region manifests for hbase-failsafe-snaptb-1701183304030-1701183314857 at 1701183315325 (+1 ms)Writing data manifest for hbase-failsafe-snaptb-1701183304030-1701183314857 at 1701183315328 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1701183304030-1701183314857 at 1701183315734 (+406 ms)Snapshot hbase-failsafe-snaptb-1701183304030-1701183314857 of table testCompactionWithHFileLink completed at 1701183315751 (+17 ms) 2023-11-28 14:55:15,752 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-28 14:55:15,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 880 msec 2023-11-28 14:55:15,980 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-28 14:55:15,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-28 14:55:15,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1701183304030-1701183314857 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-28 14:55:16,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1701183304030" table: "testCompactionWithHFileLink" creation_time: 1701183304041 type: FLUSH version: 2 ttl: 0 ) 2023-11-28 14:55:16,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1701183304030 as table=testCompactionWithHFileLink 2023-11-28 14:55:16,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-28 14:55:16,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-28 14:55:16,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-28 14:55:16,438 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-28 14:55:16,439 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-28 14:55:16,439 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-28 14:55:16,439 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-28 14:55:16,444 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1701183304030" table: "testCompactionWithHFileLink" creation_time: 1701183304041 type: FLUSH version: 2 ttl: 0 2023-11-28 14:55:16,445 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink 2023-11-28 14:55:16,450 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-28 14:55:16,453 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311282e89560c5e7d438ab97ea715e26d6b63 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311282e89560c5e7d438ab97ea715e26d6b63 2023-11-28 14:55:16,455 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311281b71483bcc784f28aa3b1e15b3e89510 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311281b71483bcc784f28aa3b1e15b3e89510 2023-11-28 14:55:16,456 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231128858d0c8df35b48ce97b03c67d23b20e4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231128858d0c8df35b48ce97b03c67d23b20e4 2023-11-28 14:55:16,456 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023112837207a5eab47444e9e023dfcb74fbbb7 of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,460 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023112842324a4769954b86aefd59ae25aca623 of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,463 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023112869c7d2b147a44cd58a0b72254a0e28d5 of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,466 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311287fb488e9c44f45a5813b81bda08d958a of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,469 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023112822da9a95b3fd4b8788db3dd8b30af9c1 of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,472 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231128544e53e43dc0434d9d1112bf9076067e of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,475 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231128633ef54bc20a43ddad245222948d9cd8 of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,478 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231128702ca0454d9647cf84d9055c8a1cc0af of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,481 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311281d6cdee687c2494d91ed22ebd7850f58 of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,484 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023112832f9f3d811b04807b25d327e5edb752d of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,486 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311289adfc7c26f1c4619a7371a15ad894feb of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,489 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231128f34bd11440044f6fb9f678a721137e3e of snapshot=snaptb-1701183304030 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-28 14:55:16,494 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231128fdce9288f5c54bfb960491860285cee7_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231128fdce9288f5c54bfb960491860285cee7_del 2023-11-28 14:55:16,495 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128ddc98b71d4044548adaa3ea7decd09e7_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231128ddc98b71d4044548adaa3ea7decd09e7_del 2023-11-28 14:55:16,496 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128ab7b2878ee7b463a8d50404531d8c3e6_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231128ab7b2878ee7b463a8d50404531d8c3e6_del 2023-11-28 14:55:16,496 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:16,496 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:16,496 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:16,500 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/7d87e168a1b74370aaa223d5586c3dad to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/7d87e168a1b74370aaa223d5586c3dad 2023-11-28 14:55:16,500 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/477444ef40294b2f935783120f320171_SeqId_29_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/477444ef40294b2f935783120f320171_SeqId_29_ 2023-11-28 14:55:16,500 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/ae6515b6238948a0b2cffd24050d9c73_SeqId_29_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/ae6515b6238948a0b2cffd24050d9c73_SeqId_29_ 2023-11-28 14:55:16,501 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/8b0e03c15c9548c094b16f17654ce087 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/8b0e03c15c9548c094b16f17654ce087 2023-11-28 14:55:16,501 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 86f8f9c43e264c7f8c93f54140e9de58 of snapshot=snaptb-1701183304030 to region=7ba6d0f18a6921527c5bcad98b88e9c1 table=testCompactionWithHFileLink 2023-11-28 14:55:16,501 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/ce9468481ca44f1caf98743e02cf81ae_SeqId_29_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/ce9468481ca44f1caf98743e02cf81ae_SeqId_29_ 2023-11-28 14:55:16,501 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/29b740755e8a481aa01e29c2ec85a132 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/29b740755e8a481aa01e29c2ec85a132 2023-11-28 14:55:16,502 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2cd99042f36149caabebd0ccb4740459 of snapshot=snaptb-1701183304030 to region=6fb4f2fcb12d20bd93bd596633c6e1d9 table=testCompactionWithHFileLink 2023-11-28 14:55:16,502 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a8a9ba5b6d1b4a97b8d2a655a04df66d of snapshot=snaptb-1701183304030 to region=f72347106c868af4e8e3936f91e9251a table=testCompactionWithHFileLink 2023-11-28 14:55:16,507 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9512074c56dc4bf69491f3d7d15233f7 of snapshot=snaptb-1701183304030 to region=6fb4f2fcb12d20bd93bd596633c6e1d9 table=testCompactionWithHFileLink 2023-11-28 14:55:16,507 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ed0f29a61eac42c98406ee1f64fcbbde of snapshot=snaptb-1701183304030 to region=7ba6d0f18a6921527c5bcad98b88e9c1 table=testCompactionWithHFileLink 2023-11-28 14:55:16,507 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 88699d8d9fbf49cea36cd94bcc5aa6af of snapshot=snaptb-1701183304030 to region=f72347106c868af4e8e3936f91e9251a table=testCompactionWithHFileLink 2023-11-28 14:55:16,512 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6bdce13974cd485dbfda90c7545311e2 of snapshot=snaptb-1701183304030 to region=f72347106c868af4e8e3936f91e9251a table=testCompactionWithHFileLink 2023-11-28 14:55:16,512 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5e64e81070aa4037b8b03ca75c99277b of snapshot=snaptb-1701183304030 to region=6fb4f2fcb12d20bd93bd596633c6e1d9 table=testCompactionWithHFileLink 2023-11-28 14:55:16,513 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b50f25d4ef6e41909bb781c70deb3e98 of snapshot=snaptb-1701183304030 to region=7ba6d0f18a6921527c5bcad98b88e9c1 table=testCompactionWithHFileLink 2023-11-28 14:55:16,520 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bc03fd33d4e24fba84aff3b7f85973df of snapshot=snaptb-1701183304030 to region=6fb4f2fcb12d20bd93bd596633c6e1d9 table=testCompactionWithHFileLink 2023-11-28 14:55:16,521 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 81e8ab6b909e440a8f5a060a1f8ce10e of snapshot=snaptb-1701183304030 to region=f72347106c868af4e8e3936f91e9251a table=testCompactionWithHFileLink 2023-11-28 14:55:16,528 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9907c6de2a964f3791331df51d33a275 of snapshot=snaptb-1701183304030 to region=7ba6d0f18a6921527c5bcad98b88e9c1 table=testCompactionWithHFileLink 2023-11-28 14:55:16,532 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/c120b9b3750547d8be6275b94f0806ed to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/c120b9b3750547d8be6275b94f0806ed 2023-11-28 14:55:16,532 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b0e63793b0c24f3f8250fda725aa60c1 of snapshot=snaptb-1701183304030 to region=6fb4f2fcb12d20bd93bd596633c6e1d9 table=testCompactionWithHFileLink 2023-11-28 14:55:16,532 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/2d1466e4b34c4152b807670f2c9f36df to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/2d1466e4b34c4152b807670f2c9f36df 2023-11-28 14:55:16,532 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e13329c32b8a412e9e0b9ced0189f0cb of snapshot=snaptb-1701183304030 to region=f72347106c868af4e8e3936f91e9251a table=testCompactionWithHFileLink 2023-11-28 14:55:16,541 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b613348235f34f1584916b1a5c973cb9 of snapshot=snaptb-1701183304030 to region=6fb4f2fcb12d20bd93bd596633c6e1d9 table=testCompactionWithHFileLink 2023-11-28 14:55:16,541 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c3358d9dc58147108a1db3e9be545892 of snapshot=snaptb-1701183304030 to region=f72347106c868af4e8e3936f91e9251a table=testCompactionWithHFileLink 2023-11-28 14:55:16,541 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/a8c6bf78881c45188785e313de156f77 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/a8c6bf78881c45188785e313de156f77 2023-11-28 14:55:16,541 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 571a03a1fa15461fa456c1c11ae55eae of snapshot=snaptb-1701183304030 to region=7ba6d0f18a6921527c5bcad98b88e9c1 table=testCompactionWithHFileLink 2023-11-28 14:55:16,545 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 39da9cf59b134f42953ccfd90d928be0 of snapshot=snaptb-1701183304030 to region=f72347106c868af4e8e3936f91e9251a table=testCompactionWithHFileLink 2023-11-28 14:55:16,545 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 68ffb2a003114c65b9b641afda3559d9 of snapshot=snaptb-1701183304030 to region=6fb4f2fcb12d20bd93bd596633c6e1d9 table=testCompactionWithHFileLink 2023-11-28 14:55:16,545 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4e0de66b24804ee4911b24bb97a39a2d of snapshot=snaptb-1701183304030 to region=7ba6d0f18a6921527c5bcad98b88e9c1 table=testCompactionWithHFileLink 2023-11-28 14:55:16,548 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink aca82a017ed646d79a47ce4e0bbdcbe3 of snapshot=snaptb-1701183304030 to region=f72347106c868af4e8e3936f91e9251a table=testCompactionWithHFileLink 2023-11-28 14:55:16,549 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b7af3b671f964a838aca1c9b3feb9651 of snapshot=snaptb-1701183304030 to region=7ba6d0f18a6921527c5bcad98b88e9c1 table=testCompactionWithHFileLink 2023-11-28 14:55:16,549 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 859742d0bba7441980ea01b482239d4a of snapshot=snaptb-1701183304030 to region=6fb4f2fcb12d20bd93bd596633c6e1d9 table=testCompactionWithHFileLink 2023-11-28 14:55:16,552 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 82a39b75f91e4111a962c07a9e5bb881 of snapshot=snaptb-1701183304030 to region=7ba6d0f18a6921527c5bcad98b88e9c1 table=testCompactionWithHFileLink 2023-11-28 14:55:16,555 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1701183304030" table: "testCompactionWithHFileLink" creation_time: 1701183304041 type: FLUSH version: 2 ttl: 0 2023-11-28 14:55:16,557 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701183316557"}]},"ts":"9223372036854775807"} 2023-11-28 14:55:16,557 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701183316557"}]},"ts":"9223372036854775807"} 2023-11-28 14:55:16,557 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701183316557"}]},"ts":"9223372036854775807"} 2023-11-28 14:55:16,558 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-28 14:55:16,559 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6fb4f2fcb12d20bd93bd596633c6e1d9, NAME => 'testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 7ba6d0f18a6921527c5bcad98b88e9c1, NAME => 'testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f72347106c868af4e8e3936f91e9251a, NAME => 'testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-28 14:55:16,559 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183316558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183316558"}]},"ts":"1701183316558"} 2023-11-28 14:55:16,559 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183316558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183316558"}]},"ts":"1701183316558"} 2023-11-28 14:55:16,559 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183316558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183316558"}]},"ts":"1701183316558"} 2023-11-28 14:55:16,560 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-28 14:55:16,560 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-28 14:55:16,560 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 6fb4f2fcb12d20bd93bd596633c6e1d9, NAME => 'testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 7ba6d0f18a6921527c5bcad98b88e9c1, NAME => 'testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f72347106c868af4e8e3936f91e9251a, NAME => 'testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-28 14:55:16,561 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1701183304030 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-28 14:55:16,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1701183304030" table: "testCompactionWithHFileLink" creation_time: 1701183304041 type: FLUSH version: 2 ttl: 0 ) in 542 msec 2023-11-28 14:55:16,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-28 14:55:16,634 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-28 14:55:16,634 INFO [Listener at localhost/45519] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1701183304030-1701183314857 2023-11-28 14:55:16,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1701183304030-1701183314857" 2023-11-28 14:55:16,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1701183304030-1701183314857 2023-11-28 14:55:16,643 INFO [Listener at localhost/45519] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-28 14:55:16,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-28 14:55:16,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-28 14:55:16,655 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-28 14:55:16,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-28 14:55:16,655 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183316655"}]},"ts":"1701183316655"} 2023-11-28 14:55:16,657 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-28 14:55:16,659 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-28 14:55:16,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, ASSIGN}] 2023-11-28 14:55:16,660 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, ASSIGN 2023-11-28 14:55:16,661 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, ASSIGN 2023-11-28 14:55:16,661 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, ASSIGN 2023-11-28 14:55:16,661 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-28 14:55:16,661 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-28 14:55:16,661 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-28 14:55:16,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-28 14:55:16,813 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6fb4f2fcb12d20bd93bd596633c6e1d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:16,813 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=f72347106c868af4e8e3936f91e9251a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:16,813 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183316813"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183316813"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183316813"}]},"ts":"1701183316813"} 2023-11-28 14:55:16,813 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=7ba6d0f18a6921527c5bcad98b88e9c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:16,813 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183316813"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183316813"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183316813"}]},"ts":"1701183316813"} 2023-11-28 14:55:16,813 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183316813"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183316813"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183316813"}]},"ts":"1701183316813"} 2023-11-28 14:55:16,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 6fb4f2fcb12d20bd93bd596633c6e1d9, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:16,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure f72347106c868af4e8e3936f91e9251a, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:16,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 7ba6d0f18a6921527c5bcad98b88e9c1, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:16,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-28 14:55:16,966 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:16,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ba6d0f18a6921527c5bcad98b88e9c1, NAME => 'testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.', STARTKEY => '', ENDKEY => '1'} 2023-11-28 14:55:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:16,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:16,970 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:16,971 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1 2023-11-28 14:55:16,971 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1 2023-11-28 14:55:16,972 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ba6d0f18a6921527c5bcad98b88e9c1 columnFamilyName family1 2023-11-28 14:55:16,981 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-86f8f9c43e264c7f8c93f54140e9de58 2023-11-28 14:55:16,986 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-9907c6de2a964f3791331df51d33a275 2023-11-28 14:55:16,991 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b50f25d4ef6e41909bb781c70deb3e98 2023-11-28 14:55:16,996 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-ed0f29a61eac42c98406ee1f64fcbbde 2023-11-28 14:55:16,996 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(310): Store=7ba6d0f18a6921527c5bcad98b88e9c1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:16,997 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:16,997 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2 2023-11-28 14:55:16,997 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2 2023-11-28 14:55:16,998 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ba6d0f18a6921527c5bcad98b88e9c1 columnFamilyName family2 2023-11-28 14:55:17,004 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-4e0de66b24804ee4911b24bb97a39a2d 2023-11-28 14:55:17,010 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-571a03a1fa15461fa456c1c11ae55eae 2023-11-28 14:55:17,015 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-82a39b75f91e4111a962c07a9e5bb881 2023-11-28 14:55:17,021 DEBUG [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b7af3b671f964a838aca1c9b3feb9651 2023-11-28 14:55:17,021 INFO [StoreOpener-7ba6d0f18a6921527c5bcad98b88e9c1-1] regionserver.HStore(310): Store=7ba6d0f18a6921527c5bcad98b88e9c1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:17,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:17,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:17,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:55:17,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:55:17,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ba6d0f18a6921527c5bcad98b88e9c1; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60064823, jitterRate=-0.10496439039707184}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:55:17,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:17,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1., pid=103, masterSystemTime=1701183316966 2023-11-28 14:55:17,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:55:17,027 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-28 14:55:17,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-28 14:55:17,027 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-28 14:55:17,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:17,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:17,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:17,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f72347106c868af4e8e3936f91e9251a, NAME => 'testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.', STARTKEY => '1', ENDKEY => '2'} 2023-11-28 14:55:17,029 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=7ba6d0f18a6921527c5bcad98b88e9c1, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:17,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:17,030 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183317029"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183317029"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183317029"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183317029"}]},"ts":"1701183317029"} 2023-11-28 14:55:17,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:17,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:17,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:17,030 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-28 14:55:17,030 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-28 14:55:17,030 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1912): 7ba6d0f18a6921527c5bcad98b88e9c1/family2 is initiating minor compaction (all files) 2023-11-28 14:55:17,031 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 7ba6d0f18a6921527c5bcad98b88e9c1/family2 in testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:17,031 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-571a03a1fa15461fa456c1c11ae55eae, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-4e0de66b24804ee4911b24bb97a39a2d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b7af3b671f964a838aca1c9b3feb9651, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-82a39b75f91e4111a962c07a9e5bb881] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp, totalSize=20.4 K 2023-11-28 14:55:17,030 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1912): 7ba6d0f18a6921527c5bcad98b88e9c1/family1 is initiating minor compaction (all files) 2023-11-28 14:55:17,031 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7ba6d0f18a6921527c5bcad98b88e9c1/family1 in testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:55:17,031 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:17,031 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-86f8f9c43e264c7f8c93f54140e9de58, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-ed0f29a61eac42c98406ee1f64fcbbde, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b50f25d4ef6e41909bb781c70deb3e98, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-9907c6de2a964f3791331df51d33a275] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp, totalSize=21.6 K 2023-11-28 14:55:17,032 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-571a03a1fa15461fa456c1c11ae55eae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297199 2023-11-28 14:55:17,032 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-86f8f9c43e264c7f8c93f54140e9de58, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297199 2023-11-28 14:55:17,032 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1 2023-11-28 14:55:17,032 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1 2023-11-28 14:55:17,033 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-4e0de66b24804ee4911b24bb97a39a2d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299007 2023-11-28 14:55:17,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=103, resume processing ppid=98 2023-11-28 14:55:17,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 7ba6d0f18a6921527c5bcad98b88e9c1, server=jenkins-hbase4.apache.org,41403,1701183201531 in 216 msec 2023-11-28 14:55:17,033 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-ed0f29a61eac42c98406ee1f64fcbbde, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299007 2023-11-28 14:55:17,033 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f72347106c868af4e8e3936f91e9251a columnFamilyName family1 2023-11-28 14:55:17,034 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b7af3b671f964a838aca1c9b3feb9651, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300810 2023-11-28 14:55:17,034 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b50f25d4ef6e41909bb781c70deb3e98, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300810 2023-11-28 14:55:17,034 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=7ba6d0f18a6921527c5bcad98b88e9c1, ASSIGN in 374 msec 2023-11-28 14:55:17,035 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-9907c6de2a964f3791331df51d33a275, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302218 2023-11-28 14:55:17,035 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-82a39b75f91e4111a962c07a9e5bb881, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302218 2023-11-28 14:55:17,048 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-6bdce13974cd485dbfda90c7545311e2 2023-11-28 14:55:17,056 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-81e8ab6b909e440a8f5a060a1f8ce10e 2023-11-28 14:55:17,075 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-88699d8d9fbf49cea36cd94bcc5aa6af 2023-11-28 14:55:17,080 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7ba6d0f18a6921527c5bcad98b88e9c1#family1#compaction#112 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:17,084 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] throttle.PressureAwareThroughputController(145): 7ba6d0f18a6921527c5bcad98b88e9c1#family2#compaction#113 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:17,087 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-a8a9ba5b6d1b4a97b8d2a655a04df66d 2023-11-28 14:55:17,088 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(310): Store=f72347106c868af4e8e3936f91e9251a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:17,089 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:17,089 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2 2023-11-28 14:55:17,090 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2 2023-11-28 14:55:17,090 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f72347106c868af4e8e3936f91e9251a columnFamilyName family2 2023-11-28 14:55:17,102 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-39da9cf59b134f42953ccfd90d928be0 2023-11-28 14:55:17,106 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-aca82a017ed646d79a47ce4e0bbdcbe3 2023-11-28 14:55:17,112 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-c3358d9dc58147108a1db3e9be545892 2023-11-28 14:55:17,117 DEBUG [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-e13329c32b8a412e9e0b9ced0189f0cb 2023-11-28 14:55:17,117 INFO [StoreOpener-f72347106c868af4e8e3936f91e9251a-1] regionserver.HStore(310): Store=f72347106c868af4e8e3936f91e9251a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:17,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:17,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:17,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:55:17,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f72347106c868af4e8e3936f91e9251a 2023-11-28 14:55:17,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f72347106c868af4e8e3936f91e9251a; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68394843, jitterRate=0.019162580370903015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:55:17,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:17,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a., pid=102, masterSystemTime=1701183316966 2023-11-28 14:55:17,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-28 14:55:17,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-28 14:55:17,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:17,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:17,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:17,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6fb4f2fcb12d20bd93bd596633c6e1d9, NAME => 'testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.', STARTKEY => '2', ENDKEY => ''} 2023-11-28 14:55:17,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:17,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=f72347106c868af4e8e3936f91e9251a, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:17,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:17,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183317125"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183317125"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183317125"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183317125"}]},"ts":"1701183317125"} 2023-11-28 14:55:17,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:17,127 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:17,128 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1 2023-11-28 14:55:17,128 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1 2023-11-28 14:55:17,128 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fb4f2fcb12d20bd93bd596633c6e1d9 columnFamilyName family1 2023-11-28 14:55:17,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=102, resume processing ppid=99 2023-11-28 14:55:17,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure f72347106c868af4e8e3936f91e9251a, server=jenkins-hbase4.apache.org,41403,1701183201531 in 312 msec 2023-11-28 14:55:17,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f72347106c868af4e8e3936f91e9251a, ASSIGN in 469 msec 2023-11-28 14:55:17,137 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-2cd99042f36149caabebd0ccb4740459 2023-11-28 14:55:17,142 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-5e64e81070aa4037b8b03ca75c99277b 2023-11-28 14:55:17,147 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-9512074c56dc4bf69491f3d7d15233f7 2023-11-28 14:55:17,157 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-bc03fd33d4e24fba84aff3b7f85973df 2023-11-28 14:55:17,158 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(310): Store=6fb4f2fcb12d20bd93bd596633c6e1d9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:17,158 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:17,159 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2 2023-11-28 14:55:17,159 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2 2023-11-28 14:55:17,159 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fb4f2fcb12d20bd93bd596633c6e1d9 columnFamilyName family2 2023-11-28 14:55:17,167 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-68ffb2a003114c65b9b641afda3559d9 2023-11-28 14:55:17,173 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-859742d0bba7441980ea01b482239d4a 2023-11-28 14:55:17,179 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b0e63793b0c24f3f8250fda725aa60c1 2023-11-28 14:55:17,184 DEBUG [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(539): loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b613348235f34f1584916b1a5c973cb9 2023-11-28 14:55:17,185 INFO [StoreOpener-6fb4f2fcb12d20bd93bd596633c6e1d9-1] regionserver.HStore(310): Store=6fb4f2fcb12d20bd93bd596633c6e1d9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:17,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:17,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:17,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:55:17,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:55:17,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6fb4f2fcb12d20bd93bd596633c6e1d9; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61593163, jitterRate=-0.08219034969806671}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:55:17,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:17,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9., pid=101, masterSystemTime=1701183316966 2023-11-28 14:55:17,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-28 14:55:17,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-28 14:55:17,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:17,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:17,192 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6fb4f2fcb12d20bd93bd596633c6e1d9, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:17,192 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701183317192"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183317192"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183317192"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183317192"}]},"ts":"1701183317192"} 2023-11-28 14:55:17,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=101, resume processing ppid=100 2023-11-28 14:55:17,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 6fb4f2fcb12d20bd93bd596633c6e1d9, server=jenkins-hbase4.apache.org,41403,1701183201531 in 379 msec 2023-11-28 14:55:17,195 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=100, resume processing ppid=97 2023-11-28 14:55:17,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=6fb4f2fcb12d20bd93bd596633c6e1d9, ASSIGN in 535 msec 2023-11-28 14:55:17,196 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183317196"}]},"ts":"1701183317196"} 2023-11-28 14:55:17,197 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-28 14:55:17,199 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-28 14:55:17,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 552 msec 2023-11-28 14:55:17,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-28 14:55:17,259 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-28 14:55:17,276 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:17,282 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:17,291 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:17,292 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:17,297 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-28 14:55:17,311 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-28 14:55:17,311 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:17,312 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(139): Connect 0x14921606 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:55:17,317 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29bf87a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:55:17,317 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:17,317 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:17,317 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:17,804 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311289e5bc0a3cd4f4c8eb7e8e9432c3f66d5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311289e5bc0a3cd4f4c8eb7e8e9432c3f66d5 2023-11-28 14:55:17,805 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:17,817 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:55:17,820 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:55:17,827 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:55:17,834 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:55:17,846 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128/family1/c154a2afc32b432ea0a442878cc05120 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-28 14:55:17,847 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128/family1/c154a2afc32b432ea0a442878cc05120}] 2023-11-28 14:55:17,852 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128/family1/c154a2afc32b432ea0a442878cc05120 for inclusion in f72347106c868af4e8e3936f91e9251a/family1 2023-11-28 14:55:17,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-28 14:55:17,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-28 14:55:17,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:17,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128/family1/c154a2afc32b432ea0a442878cc05120 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__fd7eou3t4qbkqs3urauv46d957e4ftbdskeknhb79fkrt4lpsuf3rjikvnq5677n/family1/c154a2afc32b432ea0a442878cc05120 2023-11-28 14:55:17,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__fd7eou3t4qbkqs3urauv46d957e4ftbdskeknhb79fkrt4lpsuf3rjikvnq5677n/family1/c154a2afc32b432ea0a442878cc05120 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/8ae1a4bf3896409caa604b163618b056_SeqId_34_ 2023-11-28 14:55:17,857 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__fd7eou3t4qbkqs3urauv46d957e4ftbdskeknhb79fkrt4lpsuf3rjikvnq5677n/family1/c154a2afc32b432ea0a442878cc05120 into f72347106c868af4e8e3936f91e9251a/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/8ae1a4bf3896409caa604b163618b056_SeqId_34_ - updating store file list. 2023-11-28 14:55:17,860 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/8ae1a4bf3896409caa604b163618b056_SeqId_34_ into f72347106c868af4e8e3936f91e9251a/family1 2023-11-28 14:55:17,860 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__fd7eou3t4qbkqs3urauv46d957e4ftbdskeknhb79fkrt4lpsuf3rjikvnq5677n/family1/c154a2afc32b432ea0a442878cc05120 into f72347106c868af4e8e3936f91e9251a/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/8ae1a4bf3896409caa604b163618b056_SeqId_34_) 2023-11-28 14:55:17,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__fd7eou3t4qbkqs3urauv46d957e4ftbdskeknhb79fkrt4lpsuf3rjikvnq5677n/family1/c154a2afc32b432ea0a442878cc05120 2023-11-28 14:55:17,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:17,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-28 14:55:17,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(1912): f72347106c868af4e8e3936f91e9251a/family1 is initiating minor compaction (all files) 2023-11-28 14:55:17,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@8479e4f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-28 14:55:17,865 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:17,865 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:17,866 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023112837207a5eab47444e9e023dfcb74fbbb7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023112837207a5eab47444e9e023dfcb74fbbb7 2023-11-28 14:55:17,867 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023112842324a4769954b86aefd59ae25aca623 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023112842324a4769954b86aefd59ae25aca623 2023-11-28 14:55:17,868 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023112869c7d2b147a44cd58a0b72254a0e28d5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023112869c7d2b147a44cd58a0b72254a0e28d5 2023-11-28 14:55:17,869 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311287fb488e9c44f45a5813b81bda08d958a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311287fb488e9c44f45a5813b81bda08d958a 2023-11-28 14:55:17,869 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-28 14:55:17,869 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231128' 2023-11-28 14:55:17,869 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:18,197 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128e0c762cf58a84eb8b432812ed1aefbc7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231128e0c762cf58a84eb8b432812ed1aefbc7 2023-11-28 14:55:18,198 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:18,201 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311286b58a03bba884af1ba6d2192cdfcd851 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311286b58a03bba884af1ba6d2192cdfcd851 2023-11-28 14:55:18,202 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:18,231 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128/family1/2728e64d818a4f7a80ede17fb1da90a9 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-28 14:55:18,232 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=32 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128/family1/2728e64d818a4f7a80ede17fb1da90a9}] 2023-11-28 14:55:18,233 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128/family1/52df81508c7740c2b6c337857eab60c6 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-28 14:55:18,234 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128/family1/52df81508c7740c2b6c337857eab60c6}] 2023-11-28 14:55:18,234 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128/family1/2728e64d818a4f7a80ede17fb1da90a9 for inclusion in 7ba6d0f18a6921527c5bcad98b88e9c1/family1 2023-11-28 14:55:18,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128/family1/52df81508c7740c2b6c337857eab60c6 for inclusion in 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 2023-11-28 14:55:18,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-28 14:55:18,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last=1 2023-11-28 14:55:18,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:18,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128/family1/2728e64d818a4f7a80ede17fb1da90a9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__bhn27arb1jbru05ptm3su6f8cbbo6ogrb6tqoestlh4r4skisctg3ctmnuvt3pn7/family1/2728e64d818a4f7a80ede17fb1da90a9 2023-11-28 14:55:18,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-28 14:55:18,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-28 14:55:18,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:18,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128/family1/52df81508c7740c2b6c337857eab60c6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__orvk3vm6pjs1cd4cljs8rpjcpdfcj8f7pg656q3j5pprt3hs02ch1rlpmn1qb4vn/family1/52df81508c7740c2b6c337857eab60c6 2023-11-28 14:55:18,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__bhn27arb1jbru05ptm3su6f8cbbo6ogrb6tqoestlh4r4skisctg3ctmnuvt3pn7/family1/2728e64d818a4f7a80ede17fb1da90a9 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9d36372680ef457eaadde203ae47180d_SeqId_34_ 2023-11-28 14:55:18,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__bhn27arb1jbru05ptm3su6f8cbbo6ogrb6tqoestlh4r4skisctg3ctmnuvt3pn7/family1/2728e64d818a4f7a80ede17fb1da90a9 into 7ba6d0f18a6921527c5bcad98b88e9c1/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9d36372680ef457eaadde203ae47180d_SeqId_34_ - updating store file list. 2023-11-28 14:55:18,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__orvk3vm6pjs1cd4cljs8rpjcpdfcj8f7pg656q3j5pprt3hs02ch1rlpmn1qb4vn/family1/52df81508c7740c2b6c337857eab60c6 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/dd6d76f3f5e742d08300e93ede20b458_SeqId_34_ 2023-11-28 14:55:18,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__orvk3vm6pjs1cd4cljs8rpjcpdfcj8f7pg656q3j5pprt3hs02ch1rlpmn1qb4vn/family1/52df81508c7740c2b6c337857eab60c6 into 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/dd6d76f3f5e742d08300e93ede20b458_SeqId_34_ - updating store file list. 2023-11-28 14:55:18,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9d36372680ef457eaadde203ae47180d_SeqId_34_ into 7ba6d0f18a6921527c5bcad98b88e9c1/family1 2023-11-28 14:55:18,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__bhn27arb1jbru05ptm3su6f8cbbo6ogrb6tqoestlh4r4skisctg3ctmnuvt3pn7/family1/2728e64d818a4f7a80ede17fb1da90a9 into 7ba6d0f18a6921527c5bcad98b88e9c1/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/9d36372680ef457eaadde203ae47180d_SeqId_34_) 2023-11-28 14:55:18,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__bhn27arb1jbru05ptm3su6f8cbbo6ogrb6tqoestlh4r4skisctg3ctmnuvt3pn7/family1/2728e64d818a4f7a80ede17fb1da90a9 2023-11-28 14:55:18,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/dd6d76f3f5e742d08300e93ede20b458_SeqId_34_ into 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 2023-11-28 14:55:18,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__orvk3vm6pjs1cd4cljs8rpjcpdfcj8f7pg656q3j5pprt3hs02ch1rlpmn1qb4vn/family1/52df81508c7740c2b6c337857eab60c6 into 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/dd6d76f3f5e742d08300e93ede20b458_SeqId_34_) 2023-11-28 14:55:18,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testCompactionWithHFileLink__orvk3vm6pjs1cd4cljs8rpjcpdfcj8f7pg656q3j5pprt3hs02ch1rlpmn1qb4vn/family1/52df81508c7740c2b6c337857eab60c6 2023-11-28 14:55:18,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:18,247 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:18,247 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:18,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-28 14:55:18,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 is initiating minor compaction (all files) 2023-11-28 14:55:18,249 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311281d6cdee687c2494d91ed22ebd7850f58 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311281d6cdee687c2494d91ed22ebd7850f58 2023-11-28 14:55:18,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6cacf28a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-28 14:55:18,250 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112832f9f3d811b04807b25d327e5edb752d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112832f9f3d811b04807b25d327e5edb752d 2023-11-28 14:55:18,251 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:18,252 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:18,252 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311289adfc7c26f1c4619a7371a15ad894feb to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311289adfc7c26f1c4619a7371a15ad894feb 2023-11-28 14:55:18,254 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023112822da9a95b3fd4b8788db3dd8b30af9c1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023112822da9a95b3fd4b8788db3dd8b30af9c1 2023-11-28 14:55:18,254 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231128f34bd11440044f6fb9f678a721137e3e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231128f34bd11440044f6fb9f678a721137e3e 2023-11-28 14:55:18,254 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-28 14:55:18,254 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231128' 2023-11-28 14:55:18,254 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:18,255 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231128544e53e43dc0434d9d1112bf9076067e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231128544e53e43dc0434d9d1112bf9076067e 2023-11-28 14:55:18,256 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231128633ef54bc20a43ddad245222948d9cd8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231128633ef54bc20a43ddad245222948d9cd8 2023-11-28 14:55:18,257 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231128702ca0454d9647cf84d9055c8a1cc0af to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231128702ca0454d9647cf84d9055c8a1cc0af 2023-11-28 14:55:18,257 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-28 14:55:18,257 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231128' 2023-11-28 14:55:18,258 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231128 for table='testCompactionWithHFileLink' and column='family1' 2023-11-28 14:55:18,258 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-28 14:55:18,261 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:18,264 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:18,267 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:18,268 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:18,274 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:18,275 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:18,293 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=293 (was 239) - Thread LEAK? -, OpenFileDescriptor=805 (was 631) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 161), ProcessCount=171 (was 171), AvailableMemoryMB=7617 (was 7635) 2023-11-28 14:55:18,304 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family1/45266f9a07d9414c984f70d3b49dbc52 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/45266f9a07d9414c984f70d3b49dbc52 2023-11-28 14:55:18,306 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=293, OpenFileDescriptor=805, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=171, AvailableMemoryMB=7617 2023-11-28 14:55:18,310 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 7ba6d0f18a6921527c5bcad98b88e9c1/family1 of 7ba6d0f18a6921527c5bcad98b88e9c1 into 45266f9a07d9414c984f70d3b49dbc52(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:18,310 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:18,310 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1., storeName=7ba6d0f18a6921527c5bcad98b88e9c1/family1, priority=12, startTime=1701183317027; duration=1sec 2023-11-28 14:55:18,310 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-28 14:55:18,310 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f72347106c868af4e8e3936f91e9251a/family1 in testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:18,311 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-a8a9ba5b6d1b4a97b8d2a655a04df66d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-88699d8d9fbf49cea36cd94bcc5aa6af, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-6bdce13974cd485dbfda90c7545311e2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-81e8ab6b909e440a8f5a060a1f8ce10e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/8ae1a4bf3896409caa604b163618b056_SeqId_34_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp, totalSize=28.9 K 2023-11-28 14:55:18,312 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-a8a9ba5b6d1b4a97b8d2a655a04df66d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297200 2023-11-28 14:55:18,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-28 14:55:18,313 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-88699d8d9fbf49cea36cd94bcc5aa6af, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299007 2023-11-28 14:55:18,314 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/.tmp/family2/93cb92dc28fd465bb41f915a705d5945 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/93cb92dc28fd465bb41f915a705d5945 2023-11-28 14:55:18,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-28 14:55:18,314 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-6bdce13974cd485dbfda90c7545311e2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300811 2023-11-28 14:55:18,315 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-81e8ab6b909e440a8f5a060a1f8ce10e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302219 2023-11-28 14:55:18,316 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 8ae1a4bf3896409caa604b163618b056_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1701183297200 2023-11-28 14:55:18,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-28 14:55:18,320 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 7ba6d0f18a6921527c5bcad98b88e9c1/family2 of 7ba6d0f18a6921527c5bcad98b88e9c1 into 93cb92dc28fd465bb41f915a705d5945(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:18,320 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:55:18,320 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1., storeName=7ba6d0f18a6921527c5bcad98b88e9c1/family2, priority=12, startTime=1701183317027; duration=1sec 2023-11-28 14:55:18,320 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-28 14:55:18,320 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 in testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:18,320 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-2cd99042f36149caabebd0ccb4740459, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-9512074c56dc4bf69491f3d7d15233f7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-5e64e81070aa4037b8b03ca75c99277b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-bc03fd33d4e24fba84aff3b7f85973df, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/dd6d76f3f5e742d08300e93ede20b458_SeqId_34_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp, totalSize=28.9 K 2023-11-28 14:55:18,320 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-28 14:55:18,321 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-2cd99042f36149caabebd0ccb4740459, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297201 2023-11-28 14:55:18,322 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-9512074c56dc4bf69491f3d7d15233f7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299008 2023-11-28 14:55:18,324 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-5e64e81070aa4037b8b03ca75c99277b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300811 2023-11-28 14:55:18,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-11-28 14:55:18,324 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-bc03fd33d4e24fba84aff3b7f85973df, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302219 2023-11-28 14:55:18,325 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting dd6d76f3f5e742d08300e93ede20b458_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1701183297201 2023-11-28 14:55:18,336 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): f72347106c868af4e8e3936f91e9251a#family1#compaction#114 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:18,344 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] throttle.PressureAwareThroughputController(145): 6fb4f2fcb12d20bd93bd596633c6e1d9#family1#compaction#115 average throughput is 0.47 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:18,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-86f8f9c43e264c7f8c93f54140e9de58, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-ed0f29a61eac42c98406ee1f64fcbbde, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b50f25d4ef6e41909bb781c70deb3e98, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-9907c6de2a964f3791331df51d33a275] to archive 2023-11-28 14:55:18,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:18,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-86f8f9c43e264c7f8c93f54140e9de58 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-86f8f9c43e264c7f8c93f54140e9de58 2023-11-28 14:55:18,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-ed0f29a61eac42c98406ee1f64fcbbde to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-ed0f29a61eac42c98406ee1f64fcbbde 2023-11-28 14:55:18,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b50f25d4ef6e41909bb781c70deb3e98 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b50f25d4ef6e41909bb781c70deb3e98 2023-11-28 14:55:18,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-9907c6de2a964f3791331df51d33a275 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family1/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-9907c6de2a964f3791331df51d33a275 2023-11-28 14:55:18,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-571a03a1fa15461fa456c1c11ae55eae, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-4e0de66b24804ee4911b24bb97a39a2d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b7af3b671f964a838aca1c9b3feb9651, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-82a39b75f91e4111a962c07a9e5bb881] to archive 2023-11-28 14:55:18,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:18,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-571a03a1fa15461fa456c1c11ae55eae to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-571a03a1fa15461fa456c1c11ae55eae 2023-11-28 14:55:18,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-4e0de66b24804ee4911b24bb97a39a2d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-4e0de66b24804ee4911b24bb97a39a2d 2023-11-28 14:55:18,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b7af3b671f964a838aca1c9b3feb9651 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-b7af3b671f964a838aca1c9b3feb9651 2023-11-28 14:55:18,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-82a39b75f91e4111a962c07a9e5bb881 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/family2/testCompactionWithHFileLink=7ba6d0f18a6921527c5bcad98b88e9c1-82a39b75f91e4111a962c07a9e5bb881 2023-11-28 14:55:18,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-28 14:55:18,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-28 14:55:18,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-28 14:55:18,424 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:55:18,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-28 14:55:18,425 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:55:18,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-28 14:55:18,427 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:18,427 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:18,427 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:18,427 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d empty. 2023-11-28 14:55:18,427 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55 empty. 2023-11-28 14:55:18,427 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49 empty. 2023-11-28 14:55:18,428 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:18,428 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:18,428 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:18,428 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-28 14:55:18,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-28 14:55:18,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-28 14:55:18,778 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family1/01250cf8c2934f849f6d8fabd3691ebf as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/01250cf8c2934f849f6d8fabd3691ebf 2023-11-28 14:55:18,782 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 6fb4f2fcb12d20bd93bd596633c6e1d9/family1 of 6fb4f2fcb12d20bd93bd596633c6e1d9 into 01250cf8c2934f849f6d8fabd3691ebf(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:18,782 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:18,782 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1701183318249; duration=0sec 2023-11-28 14:55:18,782 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-28 14:55:18,782 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-28 14:55:18,784 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-28 14:55:18,784 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1912): f72347106c868af4e8e3936f91e9251a/family2 is initiating minor compaction (all files) 2023-11-28 14:55:18,784 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f72347106c868af4e8e3936f91e9251a/family2 in testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:55:18,784 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-e13329c32b8a412e9e0b9ced0189f0cb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-c3358d9dc58147108a1db3e9be545892, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-39da9cf59b134f42953ccfd90d928be0, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-aca82a017ed646d79a47ce4e0bbdcbe3] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp, totalSize=20.4 K 2023-11-28 14:55:18,785 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-e13329c32b8a412e9e0b9ced0189f0cb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297200 2023-11-28 14:55:18,786 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-c3358d9dc58147108a1db3e9be545892, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299007 2023-11-28 14:55:18,786 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-39da9cf59b134f42953ccfd90d928be0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300811 2023-11-28 14:55:18,786 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-aca82a017ed646d79a47ce4e0bbdcbe3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302219 2023-11-28 14:55:18,797 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] throttle.PressureAwareThroughputController(145): f72347106c868af4e8e3936f91e9251a#family2#compaction#116 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:18,835 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-28 14:55:18,836 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1bb70c27ff1b18e08e734bf4055ade3d, NAME => 'ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:55:18,837 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 7b2311d47e8559d20609d4cfb34d2d49, NAME => 'ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:55:18,837 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1cefad5833bb4721eba3b87e37e62e55, NAME => 'ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:55:18,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-2cd99042f36149caabebd0ccb4740459, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-9512074c56dc4bf69491f3d7d15233f7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-5e64e81070aa4037b8b03ca75c99277b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-bc03fd33d4e24fba84aff3b7f85973df, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/dd6d76f3f5e742d08300e93ede20b458_SeqId_34_] to archive 2023-11-28 14:55:18,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:18,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-2cd99042f36149caabebd0ccb4740459 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-2cd99042f36149caabebd0ccb4740459 2023-11-28 14:55:18,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-9512074c56dc4bf69491f3d7d15233f7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-9512074c56dc4bf69491f3d7d15233f7 2023-11-28 14:55:18,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-5e64e81070aa4037b8b03ca75c99277b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-5e64e81070aa4037b8b03ca75c99277b 2023-11-28 14:55:18,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-bc03fd33d4e24fba84aff3b7f85973df to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-bc03fd33d4e24fba84aff3b7f85973df 2023-11-28 14:55:18,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/dd6d76f3f5e742d08300e93ede20b458_SeqId_34_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family1/dd6d76f3f5e742d08300e93ede20b458_SeqId_34_ 2023-11-28 14:55:19,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-28 14:55:19,161 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family1/57031719fb4d48ec98dc2bbd55c554fa as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/57031719fb4d48ec98dc2bbd55c554fa 2023-11-28 14:55:19,165 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in f72347106c868af4e8e3936f91e9251a/family1 of f72347106c868af4e8e3936f91e9251a into 57031719fb4d48ec98dc2bbd55c554fa(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:19,165 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:19,165 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1701183317863; duration=0sec 2023-11-28 14:55:19,165 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-28 14:55:19,165 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-28 14:55:19,167 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-28 14:55:19,167 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1912): 6fb4f2fcb12d20bd93bd596633c6e1d9/family2 is initiating minor compaction (all files) 2023-11-28 14:55:19,167 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 6fb4f2fcb12d20bd93bd596633c6e1d9/family2 in testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:55:19,168 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b0e63793b0c24f3f8250fda725aa60c1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b613348235f34f1584916b1a5c973cb9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-68ffb2a003114c65b9b641afda3559d9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-859742d0bba7441980ea01b482239d4a] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp, totalSize=20.4 K 2023-11-28 14:55:19,168 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b0e63793b0c24f3f8250fda725aa60c1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183297201 2023-11-28 14:55:19,169 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b613348235f34f1584916b1a5c973cb9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183299008 2023-11-28 14:55:19,169 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-68ffb2a003114c65b9b641afda3559d9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183300811 2023-11-28 14:55:19,170 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-859742d0bba7441980ea01b482239d4a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183302219 2023-11-28 14:55:19,180 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6fb4f2fcb12d20bd93bd596633c6e1d9#family2#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:19,246 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:19,247 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 1bb70c27ff1b18e08e734bf4055ade3d, disabling compactions & flushes 2023-11-28 14:55:19,247 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:19,247 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:19,247 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. after waiting 0 ms 2023-11-28 14:55:19,247 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:19,247 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:19,247 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:19,250 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:19,250 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 7b2311d47e8559d20609d4cfb34d2d49, disabling compactions & flushes 2023-11-28 14:55:19,250 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:19,250 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:19,250 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. after waiting 0 ms 2023-11-28 14:55:19,250 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:19,250 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:19,250 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:19,251 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:19,251 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 1cefad5833bb4721eba3b87e37e62e55, disabling compactions & flushes 2023-11-28 14:55:19,251 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:19,251 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:19,251 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. after waiting 0 ms 2023-11-28 14:55:19,251 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:19,251 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:19,251 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:19,253 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:55:19,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701183319254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183319254"}]},"ts":"1701183319254"} 2023-11-28 14:55:19,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701183319254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183319254"}]},"ts":"1701183319254"} 2023-11-28 14:55:19,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701183319254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183319254"}]},"ts":"1701183319254"} 2023-11-28 14:55:19,255 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-28 14:55:19,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-a8a9ba5b6d1b4a97b8d2a655a04df66d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-88699d8d9fbf49cea36cd94bcc5aa6af, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-6bdce13974cd485dbfda90c7545311e2, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-81e8ab6b909e440a8f5a060a1f8ce10e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/8ae1a4bf3896409caa604b163618b056_SeqId_34_] to archive 2023-11-28 14:55:19,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:55:19,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183319256"}]},"ts":"1701183319256"} 2023-11-28 14:55:19,258 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-28 14:55:19,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:19,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-a8a9ba5b6d1b4a97b8d2a655a04df66d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-a8a9ba5b6d1b4a97b8d2a655a04df66d 2023-11-28 14:55:19,261 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-88699d8d9fbf49cea36cd94bcc5aa6af to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-88699d8d9fbf49cea36cd94bcc5aa6af 2023-11-28 14:55:19,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-6bdce13974cd485dbfda90c7545311e2 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-6bdce13974cd485dbfda90c7545311e2 2023-11-28 14:55:19,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-81e8ab6b909e440a8f5a060a1f8ce10e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-81e8ab6b909e440a8f5a060a1f8ce10e 2023-11-28 14:55:19,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/8ae1a4bf3896409caa604b163618b056_SeqId_34_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family1/8ae1a4bf3896409caa604b163618b056_SeqId_34_ 2023-11-28 14:55:19,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1bb70c27ff1b18e08e734bf4055ade3d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1cefad5833bb4721eba3b87e37e62e55, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b2311d47e8559d20609d4cfb34d2d49, ASSIGN}] 2023-11-28 14:55:19,267 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1cefad5833bb4721eba3b87e37e62e55, ASSIGN 2023-11-28 14:55:19,267 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1bb70c27ff1b18e08e734bf4055ade3d, ASSIGN 2023-11-28 14:55:19,267 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b2311d47e8559d20609d4cfb34d2d49, ASSIGN 2023-11-28 14:55:19,267 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1bb70c27ff1b18e08e734bf4055ade3d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:55:19,267 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1cefad5833bb4721eba3b87e37e62e55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:55:19,267 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b2311d47e8559d20609d4cfb34d2d49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:55:19,420 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1cefad5833bb4721eba3b87e37e62e55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:19,420 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1bb70c27ff1b18e08e734bf4055ade3d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:19,420 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=7b2311d47e8559d20609d4cfb34d2d49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:19,420 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701183319420"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183319420"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183319420"}]},"ts":"1701183319420"} 2023-11-28 14:55:19,420 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701183319420"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183319420"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183319420"}]},"ts":"1701183319420"} 2023-11-28 14:55:19,420 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701183319420"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183319420"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183319420"}]},"ts":"1701183319420"} 2023-11-28 14:55:19,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 1cefad5833bb4721eba3b87e37e62e55, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:19,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 1bb70c27ff1b18e08e734bf4055ade3d, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:19,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure 7b2311d47e8559d20609d4cfb34d2d49, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:19,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-28 14:55:19,574 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:19,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:19,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1bb70c27ff1b18e08e734bf4055ade3d, NAME => 'ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d.', STARTKEY => '', ENDKEY => '1'} 2023-11-28 14:55:19,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:19,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:19,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:19,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:19,578 INFO [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:19,580 DEBUG [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1 2023-11-28 14:55:19,580 DEBUG [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1 2023-11-28 14:55:19,580 INFO [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1bb70c27ff1b18e08e734bf4055ade3d columnFamilyName family1 2023-11-28 14:55:19,581 INFO [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] regionserver.HStore(310): Store=1bb70c27ff1b18e08e734bf4055ade3d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:19,582 INFO [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:19,583 DEBUG [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2 2023-11-28 14:55:19,583 DEBUG [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2 2023-11-28 14:55:19,584 INFO [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1bb70c27ff1b18e08e734bf4055ade3d columnFamilyName family2 2023-11-28 14:55:19,586 INFO [StoreOpener-1bb70c27ff1b18e08e734bf4055ade3d-1] regionserver.HStore(310): Store=1bb70c27ff1b18e08e734bf4055ade3d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:19,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:19,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:19,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:55:19,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:55:19,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:55:19,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1bb70c27ff1b18e08e734bf4055ade3d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74937359, jitterRate=0.11665366590023041}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:55:19,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:19,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d., pid=110, masterSystemTime=1701183319574 2023-11-28 14:55:19,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:19,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:19,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:19,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b2311d47e8559d20609d4cfb34d2d49, NAME => 'ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49.', STARTKEY => '2', ENDKEY => ''} 2023-11-28 14:55:19,597 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1bb70c27ff1b18e08e734bf4055ade3d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:19,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:19,597 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701183319597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183319597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183319597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183319597"}]},"ts":"1701183319597"} 2023-11-28 14:55:19,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:19,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:19,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:19,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=110, resume processing ppid=106 2023-11-28 14:55:19,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 1bb70c27ff1b18e08e734bf4055ade3d, server=jenkins-hbase4.apache.org,41403,1701183201531 in 177 msec 2023-11-28 14:55:19,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1bb70c27ff1b18e08e734bf4055ade3d, ASSIGN in 336 msec 2023-11-28 14:55:19,604 INFO [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:19,605 DEBUG [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1 2023-11-28 14:55:19,606 DEBUG [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1 2023-11-28 14:55:19,606 INFO [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b2311d47e8559d20609d4cfb34d2d49 columnFamilyName family1 2023-11-28 14:55:19,607 INFO [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] regionserver.HStore(310): Store=7b2311d47e8559d20609d4cfb34d2d49/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:19,607 INFO [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:19,608 DEBUG [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2 2023-11-28 14:55:19,608 DEBUG [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2 2023-11-28 14:55:19,608 INFO [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b2311d47e8559d20609d4cfb34d2d49 columnFamilyName family2 2023-11-28 14:55:19,609 INFO [StoreOpener-7b2311d47e8559d20609d4cfb34d2d49-1] regionserver.HStore(310): Store=7b2311d47e8559d20609d4cfb34d2d49/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:19,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:19,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:19,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:55:19,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:55:19,614 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/.tmp/family2/a2a43739fd9245d2ad9ae8dfcbae1346 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/a2a43739fd9245d2ad9ae8dfcbae1346 2023-11-28 14:55:19,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:55:19,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7b2311d47e8559d20609d4cfb34d2d49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60656212, jitterRate=-0.09615200757980347}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:55:19,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:19,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49., pid=111, masterSystemTime=1701183319574 2023-11-28 14:55:19,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:19,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:19,619 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f72347106c868af4e8e3936f91e9251a/family2 of f72347106c868af4e8e3936f91e9251a into a2a43739fd9245d2ad9ae8dfcbae1346(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:19,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:19,619 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:55:19,619 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=7b2311d47e8559d20609d4cfb34d2d49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:19,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1cefad5833bb4721eba3b87e37e62e55, NAME => 'ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55.', STARTKEY => '1', ENDKEY => '2'} 2023-11-28 14:55:19,619 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a., storeName=f72347106c868af4e8e3936f91e9251a/family2, priority=12, startTime=1701183317124; duration=0sec 2023-11-28 14:55:19,619 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701183319619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183319619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183319619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183319619"}]},"ts":"1701183319619"} 2023-11-28 14:55:19,619 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-28 14:55:19,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:19,619 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-28 14:55:19,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:19,620 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-28 14:55:19,620 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-28 14:55:19,620 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. because compaction request was cancelled 2023-11-28 14:55:19,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:19,620 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-28 14:55:19,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:19,620 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-28 14:55:19,621 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-28 14:55:19,621 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. because compaction request was cancelled 2023-11-28 14:55:19,622 INFO [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:19,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=111, resume processing ppid=108 2023-11-28 14:55:19,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure 7b2311d47e8559d20609d4cfb34d2d49, server=jenkins-hbase4.apache.org,41403,1701183201531 in 197 msec 2023-11-28 14:55:19,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b2311d47e8559d20609d4cfb34d2d49, ASSIGN in 357 msec 2023-11-28 14:55:19,623 DEBUG [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1 2023-11-28 14:55:19,623 DEBUG [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1 2023-11-28 14:55:19,624 INFO [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cefad5833bb4721eba3b87e37e62e55 columnFamilyName family1 2023-11-28 14:55:19,624 INFO [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] regionserver.HStore(310): Store=1cefad5833bb4721eba3b87e37e62e55/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:19,625 INFO [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:19,626 DEBUG [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2 2023-11-28 14:55:19,626 DEBUG [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2 2023-11-28 14:55:19,626 INFO [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cefad5833bb4721eba3b87e37e62e55 columnFamilyName family2 2023-11-28 14:55:19,627 INFO [StoreOpener-1cefad5833bb4721eba3b87e37e62e55-1] regionserver.HStore(310): Store=1cefad5833bb4721eba3b87e37e62e55/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:19,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:19,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:19,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:55:19,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:55:19,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:55:19,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1cefad5833bb4721eba3b87e37e62e55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64483203, jitterRate=-0.03912539780139923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:55:19,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:19,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55., pid=109, masterSystemTime=1701183319574 2023-11-28 14:55:19,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:19,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:19,633 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1cefad5833bb4721eba3b87e37e62e55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:19,633 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701183319633"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183319633"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183319633"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183319633"}]},"ts":"1701183319633"} 2023-11-28 14:55:19,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=109, resume processing ppid=107 2023-11-28 14:55:19,635 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 1cefad5833bb4721eba3b87e37e62e55, server=jenkins-hbase4.apache.org,41403,1701183201531 in 212 msec 2023-11-28 14:55:19,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=107, resume processing ppid=105 2023-11-28 14:55:19,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1cefad5833bb4721eba3b87e37e62e55, ASSIGN in 370 msec 2023-11-28 14:55:19,637 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:55:19,637 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183319637"}]},"ts":"1701183319637"} 2023-11-28 14:55:19,638 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-28 14:55:19,640 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:55:19,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2180 sec 2023-11-28 14:55:19,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-e13329c32b8a412e9e0b9ced0189f0cb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-c3358d9dc58147108a1db3e9be545892, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-39da9cf59b134f42953ccfd90d928be0, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-aca82a017ed646d79a47ce4e0bbdcbe3] to archive 2023-11-28 14:55:19,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:19,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-e13329c32b8a412e9e0b9ced0189f0cb to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-e13329c32b8a412e9e0b9ced0189f0cb 2023-11-28 14:55:19,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-c3358d9dc58147108a1db3e9be545892 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-c3358d9dc58147108a1db3e9be545892 2023-11-28 14:55:19,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-39da9cf59b134f42953ccfd90d928be0 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-39da9cf59b134f42953ccfd90d928be0 2023-11-28 14:55:19,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-aca82a017ed646d79a47ce4e0bbdcbe3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/family2/testCompactionWithHFileLink=f72347106c868af4e8e3936f91e9251a-aca82a017ed646d79a47ce4e0bbdcbe3 2023-11-28 14:55:20,253 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:55:20,399 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/.tmp/family2/3263e33879434142a48e06b8c0dd9d11 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/3263e33879434142a48e06b8c0dd9d11 2023-11-28 14:55:20,404 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 6fb4f2fcb12d20bd93bd596633c6e1d9/family2 of 6fb4f2fcb12d20bd93bd596633c6e1d9 into 3263e33879434142a48e06b8c0dd9d11(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:20,404 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:55:20,404 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9., storeName=6fb4f2fcb12d20bd93bd596633c6e1d9/family2, priority=12, startTime=1701183317190; duration=1sec 2023-11-28 14:55:20,404 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:55:20,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b0e63793b0c24f3f8250fda725aa60c1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b613348235f34f1584916b1a5c973cb9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-68ffb2a003114c65b9b641afda3559d9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-859742d0bba7441980ea01b482239d4a] to archive 2023-11-28 14:55:20,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:20,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b0e63793b0c24f3f8250fda725aa60c1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b0e63793b0c24f3f8250fda725aa60c1 2023-11-28 14:55:20,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b613348235f34f1584916b1a5c973cb9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-b613348235f34f1584916b1a5c973cb9 2023-11-28 14:55:20,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-68ffb2a003114c65b9b641afda3559d9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-68ffb2a003114c65b9b641afda3559d9 2023-11-28 14:55:20,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-859742d0bba7441980ea01b482239d4a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/family2/testCompactionWithHFileLink=6fb4f2fcb12d20bd93bd596633c6e1d9-859742d0bba7441980ea01b482239d4a 2023-11-28 14:55:20,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-28 14:55:20,530 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-28 14:55:20,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:20,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:20,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:20,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:20,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-28 14:55:20,541 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-28 14:55:20,541 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:20,541 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-28 14:55:20,541 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-28 14:55:20,542 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:20,542 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:20,543 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:20,543 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:20,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:20,544 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:20,544 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:20,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:20,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-28 14:55:20,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-28 14:55:20,545 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-28 14:55:20,545 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:20,545 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-28 14:55:20,545 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:20,545 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. started... 2023-11-28 14:55:20,545 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:20,545 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. started... 2023-11-28 14:55:20,545 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:20,547 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1bb70c27ff1b18e08e734bf4055ade3d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-28 14:55:20,547 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:20,547 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:20,547 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b2311d47e8559d20609d4cfb34d2d49 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-28 14:55:20,547 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. started... 2023-11-28 14:55:20,547 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cefad5833bb4721eba3b87e37e62e55 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-28 14:55:20,573 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128fc547a489b744097a5531b883ffa40f4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231128fc547a489b744097a5531b883ffa40f4 2023-11-28 14:55:20,970 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311289bf2f44e552c458fbe9ec08810d01d38 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311289bf2f44e552c458fbe9ec08810d01d38 2023-11-28 14:55:20,973 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128c74f7065333f4579929e7f53efe8c568 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231128c74f7065333f4579929e7f53efe8c568 2023-11-28 14:55:20,984 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/bc1b56985a3c42f2ad7c431ad6fdaaab 2023-11-28 14:55:20,984 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/317866f79a23480c87b0c696597bcf91 2023-11-28 14:55:20,988 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/cfa07e39bfab46a18760bed7d34aebc7 2023-11-28 14:55:21,406 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128edd736865a484d5786b95c80ee5b4df5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231128edd736865a484d5786b95c80ee5b4df5 2023-11-28 14:55:21,406 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128276979744a6d48baa09a507da813fc71 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231128276979744a6d48baa09a507da813fc71 2023-11-28 14:55:21,409 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311281c7429b9c03f4d1989c1d802ade5dc67 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311281c7429b9c03f4d1989c1d802ade5dc67 2023-11-28 14:55:21,813 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/a311540e46d34416abe80ac513ff86da 2023-11-28 14:55:21,814 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/126bcef1f6354932a0c0ac1fcfba4a0c 2023-11-28 14:55:21,815 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/40426983fbaa42b699700356f450d238 2023-11-28 14:55:21,818 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/317866f79a23480c87b0c696597bcf91 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/317866f79a23480c87b0c696597bcf91 2023-11-28 14:55:21,819 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/bc1b56985a3c42f2ad7c431ad6fdaaab as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/bc1b56985a3c42f2ad7c431ad6fdaaab 2023-11-28 14:55:21,820 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/cfa07e39bfab46a18760bed7d34aebc7 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/cfa07e39bfab46a18760bed7d34aebc7 2023-11-28 14:55:21,824 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/317866f79a23480c87b0c696597bcf91, entries=4, sequenceid=5, filesize=5.4 K 2023-11-28 14:55:21,825 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/a311540e46d34416abe80ac513ff86da as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/a311540e46d34416abe80ac513ff86da 2023-11-28 14:55:21,825 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/bc1b56985a3c42f2ad7c431ad6fdaaab, entries=4, sequenceid=5, filesize=5.4 K 2023-11-28 14:55:21,826 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/126bcef1f6354932a0c0ac1fcfba4a0c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/126bcef1f6354932a0c0ac1fcfba4a0c 2023-11-28 14:55:21,827 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/cfa07e39bfab46a18760bed7d34aebc7, entries=4, sequenceid=5, filesize=5.4 K 2023-11-28 14:55:21,828 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/40426983fbaa42b699700356f450d238 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/40426983fbaa42b699700356f450d238 2023-11-28 14:55:21,831 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/a311540e46d34416abe80ac513ff86da, entries=2, sequenceid=5, filesize=5.1 K 2023-11-28 14:55:21,831 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/126bcef1f6354932a0c0ac1fcfba4a0c, entries=2, sequenceid=5, filesize=5.1 K 2023-11-28 14:55:21,832 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1bb70c27ff1b18e08e734bf4055ade3d in 1285ms, sequenceid=5, compaction requested=false 2023-11-28 14:55:21,832 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7b2311d47e8559d20609d4cfb34d2d49 in 1285ms, sequenceid=5, compaction requested=false 2023-11-28 14:55:21,832 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/40426983fbaa42b699700356f450d238, entries=2, sequenceid=5, filesize=5.1 K 2023-11-28 14:55:21,832 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-28 14:55:21,832 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-28 14:55:21,833 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1cefad5833bb4721eba3b87e37e62e55 in 1286ms, sequenceid=5, compaction requested=false 2023-11-28 14:55:21,833 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:21,833 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:21,833 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:21,834 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:21,834 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:21,834 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:21,834 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:21,834 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:21,834 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:21,834 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:21,835 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,835 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-28 14:55:21,835 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-28 14:55:21,837 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,837 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:21,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:21,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:21,838 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:21,838 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:21,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:21,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:21,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:21,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:21,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-28 14:55:21,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c886812[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:21,840 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-28 14:55:21,840 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:21,841 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:21,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:21,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:21,841 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-28 14:55:21,841 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-28 14:55:21,841 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:21,841 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,841 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:21,861 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-28 14:55:21,861 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:21,861 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-28 14:55:21,861 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:21,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:21,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:21,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:21,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:21,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:21,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-28 14:55:21,865 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-28 14:55:21,865 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:21,865 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:21,865 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-28 14:55:21,865 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:21,872 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:21,872 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:21,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:21,872 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:21,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:21,873 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:21,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:21,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:21,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:21,875 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:21,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,879 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,879 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:21,879 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:21,879 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:21,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:21,879 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,879 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:21,879 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:21,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-28 14:55:21,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:21,879 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:21,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:21,880 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:21,880 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:21,880 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:21,880 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:21,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:21,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:21,980 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:21,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:21,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:21,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:21,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:21,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:21,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:21,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-28 14:55:21,986 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-28 14:55:21,986 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:21,986 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-28 14:55:21,986 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-28 14:55:21,987 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:21,987 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:21,989 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:21,989 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:21,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:21,989 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:21,989 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:21,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:21,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:21,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:21,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:21,990 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-28 14:55:21,991 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-28 14:55:21,991 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-28 14:55:21,991 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-28 14:55:21,991 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:21,991 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-28 14:55:21,991 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:21,991 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. started... 2023-11-28 14:55:21,991 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:21,991 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:21,991 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. started... 2023-11-28 14:55:21,991 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1bb70c27ff1b18e08e734bf4055ade3d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-28 14:55:21,991 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:21,992 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b2311d47e8559d20609d4cfb34d2d49 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-28 14:55:21,991 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:21,992 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. started... 2023-11-28 14:55:21,992 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cefad5833bb4721eba3b87e37e62e55 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-28 14:55:22,419 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128dba1d8b056fd4c6fae6831274f023c54 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231128dba1d8b056fd4c6fae6831274f023c54 2023-11-28 14:55:22,420 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311281a4df32abaeb43fe9af7860ddbd10a34 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311281a4df32abaeb43fe9af7860ddbd10a34 2023-11-28 14:55:22,421 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311289560e4f5f0c24ac68a483911182a864a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311289560e4f5f0c24ac68a483911182a864a 2023-11-28 14:55:22,432 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/841b0660e4ed41f4aa07e5a78300a070 2023-11-28 14:55:22,433 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/dc48933a776e449c8c8a24faa10193ea 2023-11-28 14:55:22,461 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128c7fb885e79a847d4b27389c4a3a490a1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231128c7fb885e79a847d4b27389c4a3a490a1 2023-11-28 14:55:22,462 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128a0e297a3d1354ec69d933d64efb434d9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231128a0e297a3d1354ec69d933d64efb434d9 2023-11-28 14:55:22,474 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/b29e44e05fb34dfbaa3bf7cfeab200dc 2023-11-28 14:55:22,478 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/dc48933a776e449c8c8a24faa10193ea as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/dc48933a776e449c8c8a24faa10193ea 2023-11-28 14:55:22,484 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/dc48933a776e449c8c8a24faa10193ea, entries=4, sequenceid=9, filesize=5.4 K 2023-11-28 14:55:22,485 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/b29e44e05fb34dfbaa3bf7cfeab200dc as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/b29e44e05fb34dfbaa3bf7cfeab200dc 2023-11-28 14:55:22,489 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/b29e44e05fb34dfbaa3bf7cfeab200dc, entries=2, sequenceid=9, filesize=5.1 K 2023-11-28 14:55:22,490 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1bb70c27ff1b18e08e734bf4055ade3d in 499ms, sequenceid=9, compaction requested=false 2023-11-28 14:55:22,490 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:22,490 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:22,490 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:22,845 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/15035000c3ed44028171951ce2456d3e 2023-11-28 14:55:22,869 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/a95d3fb4fcaf43b7a72ccdf3814dfa1c 2023-11-28 14:55:22,872 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/841b0660e4ed41f4aa07e5a78300a070 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/841b0660e4ed41f4aa07e5a78300a070 2023-11-28 14:55:22,875 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/841b0660e4ed41f4aa07e5a78300a070, entries=4, sequenceid=9, filesize=5.4 K 2023-11-28 14:55:22,876 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/a95d3fb4fcaf43b7a72ccdf3814dfa1c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/a95d3fb4fcaf43b7a72ccdf3814dfa1c 2023-11-28 14:55:22,879 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/a95d3fb4fcaf43b7a72ccdf3814dfa1c, entries=2, sequenceid=9, filesize=5.1 K 2023-11-28 14:55:22,879 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1cefad5833bb4721eba3b87e37e62e55 in 887ms, sequenceid=9, compaction requested=false 2023-11-28 14:55:22,879 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:22,879 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:22,879 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:23,257 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128d0c145b9b95d414b9c331cee44c1cddd to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231128d0c145b9b95d414b9c331cee44c1cddd 2023-11-28 14:55:23,662 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/951ebba79358421ea836fbed91c8dad8 2023-11-28 14:55:23,666 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/15035000c3ed44028171951ce2456d3e as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/15035000c3ed44028171951ce2456d3e 2023-11-28 14:55:23,669 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/15035000c3ed44028171951ce2456d3e, entries=4, sequenceid=9, filesize=5.4 K 2023-11-28 14:55:23,670 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/951ebba79358421ea836fbed91c8dad8 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/951ebba79358421ea836fbed91c8dad8 2023-11-28 14:55:23,672 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/951ebba79358421ea836fbed91c8dad8, entries=2, sequenceid=9, filesize=5.1 K 2023-11-28 14:55:23,673 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7b2311d47e8559d20609d4cfb34d2d49 in 1681ms, sequenceid=9, compaction requested=false 2023-11-28 14:55:23,673 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:23,673 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-28 14:55:23,673 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-28 14:55:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:23,675 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:23,675 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:23,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-28 14:55:23,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b2b2425[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:23,677 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-28 14:55:23,677 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:23,678 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:23,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:23,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-28 14:55:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-28 14:55:23,678 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,678 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:23,678 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:23,680 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-28 14:55:23,680 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,680 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:23,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:23,680 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-28 14:55:23,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:23,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:23,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-28 14:55:23,682 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-28 14:55:23,682 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:23,682 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:23,682 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-28 14:55:23,682 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:23,684 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:23,684 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:23,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:23,684 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:23,684 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:23,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:23,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,685 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:23,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:23,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,688 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,688 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:23,688 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:23,688 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:23,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:23,688 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:23,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-28 14:55:23,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:23,688 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:23,688 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:23,688 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:23,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:23,688 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:23,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:23,688 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:23,689 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:23,689 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:23,789 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:23,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:23,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:23,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:23,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:23,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:23,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:23,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-28 14:55:23,795 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-28 14:55:23,795 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:23,795 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-28 14:55:23,795 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-28 14:55:23,796 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:23,796 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:23,797 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,797 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:23,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:23,798 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:23,798 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:23,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:23,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-28 14:55:23,799 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-28 14:55:23,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-28 14:55:23,799 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-28 14:55:23,799 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:23,799 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-28 14:55:23,799 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:23,799 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:23,799 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. started... 2023-11-28 14:55:23,799 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:23,799 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:23,800 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:23,800 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1bb70c27ff1b18e08e734bf4055ade3d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-28 14:55:23,800 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. started... 2023-11-28 14:55:23,799 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. started... 2023-11-28 14:55:23,800 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cefad5833bb4721eba3b87e37e62e55 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-28 14:55:23,800 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b2311d47e8559d20609d4cfb34d2d49 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-28 14:55:24,218 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128411674b716fa4b38b57666159021d3c1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231128411674b716fa4b38b57666159021d3c1 2023-11-28 14:55:24,218 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311288a286d9dcec74cbdb2febe9d33638b54 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311288a286d9dcec74cbdb2febe9d33638b54 2023-11-28 14:55:24,218 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128b9893a58b2c9407f93396dd896379cf9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231128b9893a58b2c9407f93396dd896379cf9 2023-11-28 14:55:24,228 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/ba3061ead38d4c1788391c3c038fecb1 2023-11-28 14:55:24,254 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128da384b260ec84cf79fcafce0064eeee2 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231128da384b260ec84cf79fcafce0064eeee2 2023-11-28 14:55:24,274 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/06298cbda7fc4b36a9d328fd37a508b6 2023-11-28 14:55:24,278 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/ba3061ead38d4c1788391c3c038fecb1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/ba3061ead38d4c1788391c3c038fecb1 2023-11-28 14:55:24,282 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/ba3061ead38d4c1788391c3c038fecb1, entries=4, sequenceid=13, filesize=5.4 K 2023-11-28 14:55:24,282 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/06298cbda7fc4b36a9d328fd37a508b6 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/06298cbda7fc4b36a9d328fd37a508b6 2023-11-28 14:55:24,286 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/06298cbda7fc4b36a9d328fd37a508b6, entries=2, sequenceid=13, filesize=5.1 K 2023-11-28 14:55:24,287 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1cefad5833bb4721eba3b87e37e62e55 in 487ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:24,287 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:24,287 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:24,287 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:24,627 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/7c83175141a44d8584d362040da5412e 2023-11-28 14:55:24,631 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/bf6e6c6efdc54e458c6c4f22057fc565 2023-11-28 14:55:24,653 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311280639ec05b5244cb5b07d8c846aa35686 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311280639ec05b5244cb5b07d8c846aa35686 2023-11-28 14:55:25,047 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311288a03d92524b94144bc7643b404c4bdfe to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311288a03d92524b94144bc7643b404c4bdfe 2023-11-28 14:55:25,051 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/4f43f7f61efe4d90967306f806b6f285 2023-11-28 14:55:25,056 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/7c83175141a44d8584d362040da5412e as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/7c83175141a44d8584d362040da5412e 2023-11-28 14:55:25,058 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/2fd6a1034489483bbd4d3c7d6f124d81 2023-11-28 14:55:25,059 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/7c83175141a44d8584d362040da5412e, entries=4, sequenceid=13, filesize=5.4 K 2023-11-28 14:55:25,060 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/4f43f7f61efe4d90967306f806b6f285 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/4f43f7f61efe4d90967306f806b6f285 2023-11-28 14:55:25,063 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/bf6e6c6efdc54e458c6c4f22057fc565 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/bf6e6c6efdc54e458c6c4f22057fc565 2023-11-28 14:55:25,064 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/4f43f7f61efe4d90967306f806b6f285, entries=2, sequenceid=13, filesize=5.1 K 2023-11-28 14:55:25,065 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7b2311d47e8559d20609d4cfb34d2d49 in 1265ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:25,065 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:25,065 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:25,065 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:25,068 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/bf6e6c6efdc54e458c6c4f22057fc565, entries=4, sequenceid=13, filesize=5.4 K 2023-11-28 14:55:25,069 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/2fd6a1034489483bbd4d3c7d6f124d81 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/2fd6a1034489483bbd4d3c7d6f124d81 2023-11-28 14:55:25,072 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/2fd6a1034489483bbd4d3c7d6f124d81, entries=2, sequenceid=13, filesize=5.1 K 2023-11-28 14:55:25,073 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1bb70c27ff1b18e08e734bf4055ade3d in 1273ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:25,073 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:25,073 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:25,073 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:25,073 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:25,073 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,074 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-28 14:55:25,074 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-28 14:55:25,075 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,075 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:25,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:25,076 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:25,076 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:25,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:25,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-28 14:55:25,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3139dbdd[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:25,077 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-28 14:55:25,077 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:25,079 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:25,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:25,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:25,079 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-28 14:55:25,079 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-28 14:55:25,079 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:25,079 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,079 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:25,081 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-28 14:55:25,081 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:25,081 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,081 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-28 14:55:25,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:25,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:25,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:25,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-28 14:55:25,084 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-28 14:55:25,084 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:25,084 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:25,084 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-28 14:55:25,084 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:25,085 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:25,085 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:25,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:25,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:25,085 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:25,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:25,086 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:25,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:25,088 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:25,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:25,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,093 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,093 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:25,093 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:25,093 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,093 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:25,093 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:25,093 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:25,095 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:25,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-28 14:55:25,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:25,095 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:25,096 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:25,096 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:25,096 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:25,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:25,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:25,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-28 14:55:25,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:25,121 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:55:25,151 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:55:25,151 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x297558a3 to 127.0.0.1:62725 2023-11-28 14:55:25,151 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:55:25,153 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:55:25,153 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14921606 to 127.0.0.1:62725 2023-11-28 14:55:25,153 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:55:25,196 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:25,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:25,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:25,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:25,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:25,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:25,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:25,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-28 14:55:25,202 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-28 14:55:25,202 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:25,202 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-28 14:55:25,202 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-28 14:55:25,202 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:25,203 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:25,209 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,209 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:25,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:25,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:25,210 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:25,210 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:25,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:25,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:25,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:25,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:25,211 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-28 14:55:25,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-28 14:55:25,211 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-28 14:55:25,211 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:25,211 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-28 14:55:25,211 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:25,211 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:25,211 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. started... 2023-11-28 14:55:25,212 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. started... 2023-11-28 14:55:25,212 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1bb70c27ff1b18e08e734bf4055ade3d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-28 14:55:25,212 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b2311d47e8559d20609d4cfb34d2d49 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-28 14:55:25,212 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:25,212 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:25,212 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:25,212 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. started... 2023-11-28 14:55:25,212 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cefad5833bb4721eba3b87e37e62e55 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-28 14:55:25,633 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128a4407aa73a8a4e1ab4bfcc8174d7d982 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231128a4407aa73a8a4e1ab4bfcc8174d7d982 2023-11-28 14:55:25,633 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128d120ec348a284cc1baf12bb892341159 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231128d120ec348a284cc1baf12bb892341159 2023-11-28 14:55:25,635 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128c5db507d57214fea9ce24fcd9c1068b6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231128c5db507d57214fea9ce24fcd9c1068b6 2023-11-28 14:55:26,038 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/6ad690ce73d7429a8900c0991c6151c5 2023-11-28 14:55:26,038 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/b4f6ebfdf4424d7bb4eae619056f2f28 2023-11-28 14:55:26,039 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/1e27a003ea4649e595703ced472b7ac9 2023-11-28 14:55:26,057 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311283d6bb8db9fb64594b0ea917906d717f4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311283d6bb8db9fb64594b0ea917906d717f4 2023-11-28 14:55:26,459 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128d61db48c15064ad696b76f186a912510 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231128d61db48c15064ad696b76f186a912510 2023-11-28 14:55:26,459 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311281e605a0d9f9748fdb3b247d4de4d8c91 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311281e605a0d9f9748fdb3b247d4de4d8c91 2023-11-28 14:55:26,462 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/abcfc1bd4a254f5587d3c77a74ac4790 2023-11-28 14:55:26,466 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/1e27a003ea4649e595703ced472b7ac9 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/1e27a003ea4649e595703ced472b7ac9 2023-11-28 14:55:26,472 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/1e27a003ea4649e595703ced472b7ac9, entries=4, sequenceid=17, filesize=5.4 K 2023-11-28 14:55:26,472 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/abcfc1bd4a254f5587d3c77a74ac4790 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/abcfc1bd4a254f5587d3c77a74ac4790 2023-11-28 14:55:26,476 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/abcfc1bd4a254f5587d3c77a74ac4790, entries=2, sequenceid=17, filesize=5.1 K 2023-11-28 14:55:26,477 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1cefad5833bb4721eba3b87e37e62e55 in 1265ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:26,477 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:26,477 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:26,865 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/46e8cd2ee8cc447facfc1721792b3201 2023-11-28 14:55:26,869 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/6ad690ce73d7429a8900c0991c6151c5 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/6ad690ce73d7429a8900c0991c6151c5 2023-11-28 14:55:26,870 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/5c4c7fcaa0b34a2a87c51da9358e2240 2023-11-28 14:55:26,873 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/6ad690ce73d7429a8900c0991c6151c5, entries=4, sequenceid=17, filesize=5.4 K 2023-11-28 14:55:26,873 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/46e8cd2ee8cc447facfc1721792b3201 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/46e8cd2ee8cc447facfc1721792b3201 2023-11-28 14:55:26,874 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/b4f6ebfdf4424d7bb4eae619056f2f28 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/b4f6ebfdf4424d7bb4eae619056f2f28 2023-11-28 14:55:26,877 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/46e8cd2ee8cc447facfc1721792b3201, entries=2, sequenceid=17, filesize=5.1 K 2023-11-28 14:55:26,877 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/b4f6ebfdf4424d7bb4eae619056f2f28, entries=4, sequenceid=17, filesize=5.4 K 2023-11-28 14:55:26,878 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7b2311d47e8559d20609d4cfb34d2d49 in 1666ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:26,878 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:26,878 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:26,878 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:26,878 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/5c4c7fcaa0b34a2a87c51da9358e2240 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/5c4c7fcaa0b34a2a87c51da9358e2240 2023-11-28 14:55:26,882 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/5c4c7fcaa0b34a2a87c51da9358e2240, entries=2, sequenceid=17, filesize=5.1 K 2023-11-28 14:55:26,882 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1bb70c27ff1b18e08e734bf4055ade3d in 1670ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:26,882 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:26,882 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:26,882 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:26,882 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:26,882 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,883 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-28 14:55:26,883 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-28 14:55:26,884 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:26,884 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:26,885 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:26,885 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:26,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-28 14:55:26,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bf696a3[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:26,886 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-28 14:55:26,887 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:26,888 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:26,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:26,888 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-28 14:55:26,888 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-28 14:55:26,888 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:26,889 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,889 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:26,890 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-28 14:55:26,890 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,890 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:26,890 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-28 14:55:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:26,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-28 14:55:26,892 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-28 14:55:26,892 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:26,892 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:26,892 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-28 14:55:26,892 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:26,895 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:26,896 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:26,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:26,896 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:26,896 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:26,897 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:26,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:26,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-28 14:55:26,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:26,900 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:26,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:26,900 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:26,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:27,000 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:27,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:27,012 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:27,025 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:27,036 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:27,037 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:27,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:27,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:27,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-28 14:55:27,068 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-28 14:55:27,068 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:27,068 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-28 14:55:27,068 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-28 14:55:27,069 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:27,069 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:27,070 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:27,070 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:27,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:27,070 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:27,070 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:27,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:27,071 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-28 14:55:27,071 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-28 14:55:27,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-28 14:55:27,072 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-28 14:55:27,072 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:27,072 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-28 14:55:27,072 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:27,072 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. started... 2023-11-28 14:55:27,072 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1bb70c27ff1b18e08e734bf4055ade3d 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-28 14:55:27,076 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:27,076 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:27,076 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:27,076 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. started... 2023-11-28 14:55:27,076 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:27,076 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. started... 2023-11-28 14:55:27,076 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b2311d47e8559d20609d4cfb34d2d49 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-28 14:55:27,076 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cefad5833bb4721eba3b87e37e62e55 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-28 14:55:27,893 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/b66ea15df2ce40df863f840401b99f57 2023-11-28 14:55:27,893 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/58d3f4c89b744fd9b6d689dfbf91e0a6 2023-11-28 14:55:27,893 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/3aac79db74044685a5608c653c565696 2023-11-28 14:55:27,897 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58d3f4c89b744fd9b6d689dfbf91e0a6 2023-11-28 14:55:27,897 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b66ea15df2ce40df863f840401b99f57 2023-11-28 14:55:27,897 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3aac79db74044685a5608c653c565696 2023-11-28 14:55:28,311 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/b549c706bed949a69e2cb06ae991fe9a 2023-11-28 14:55:28,314 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b549c706bed949a69e2cb06ae991fe9a 2023-11-28 14:55:28,315 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/3aac79db74044685a5608c653c565696 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/3aac79db74044685a5608c653c565696 2023-11-28 14:55:28,318 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3aac79db74044685a5608c653c565696 2023-11-28 14:55:28,318 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/3aac79db74044685a5608c653c565696, entries=3, sequenceid=23, filesize=5.0 K 2023-11-28 14:55:28,319 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/b549c706bed949a69e2cb06ae991fe9a as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/b549c706bed949a69e2cb06ae991fe9a 2023-11-28 14:55:28,322 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b549c706bed949a69e2cb06ae991fe9a 2023-11-28 14:55:28,322 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/b549c706bed949a69e2cb06ae991fe9a, entries=1, sequenceid=23, filesize=5.0 K 2023-11-28 14:55:28,323 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1cefad5833bb4721eba3b87e37e62e55 in 1247ms, sequenceid=23, compaction requested=true 2023-11-28 14:55:28,323 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:28,323 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:28,323 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:28,712 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/9966c0e2dfec48658aa08ca09480fc51 2023-11-28 14:55:28,712 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/41f17b44a03d46f1899db6386ba46f55 2023-11-28 14:55:28,716 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9966c0e2dfec48658aa08ca09480fc51 2023-11-28 14:55:28,717 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/58d3f4c89b744fd9b6d689dfbf91e0a6 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/58d3f4c89b744fd9b6d689dfbf91e0a6 2023-11-28 14:55:28,720 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41f17b44a03d46f1899db6386ba46f55 2023-11-28 14:55:28,720 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58d3f4c89b744fd9b6d689dfbf91e0a6 2023-11-28 14:55:28,720 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/58d3f4c89b744fd9b6d689dfbf91e0a6, entries=3, sequenceid=23, filesize=5.0 K 2023-11-28 14:55:28,721 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/b66ea15df2ce40df863f840401b99f57 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/b66ea15df2ce40df863f840401b99f57 2023-11-28 14:55:28,721 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/9966c0e2dfec48658aa08ca09480fc51 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/9966c0e2dfec48658aa08ca09480fc51 2023-11-28 14:55:28,724 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b66ea15df2ce40df863f840401b99f57 2023-11-28 14:55:28,724 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/b66ea15df2ce40df863f840401b99f57, entries=3, sequenceid=23, filesize=5.0 K 2023-11-28 14:55:28,725 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9966c0e2dfec48658aa08ca09480fc51 2023-11-28 14:55:28,725 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/9966c0e2dfec48658aa08ca09480fc51, entries=1, sequenceid=23, filesize=5.0 K 2023-11-28 14:55:28,725 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/41f17b44a03d46f1899db6386ba46f55 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/41f17b44a03d46f1899db6386ba46f55 2023-11-28 14:55:28,726 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1bb70c27ff1b18e08e734bf4055ade3d in 1654ms, sequenceid=23, compaction requested=true 2023-11-28 14:55:28,726 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:28,726 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:28,726 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:28,729 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41f17b44a03d46f1899db6386ba46f55 2023-11-28 14:55:28,729 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/41f17b44a03d46f1899db6386ba46f55, entries=1, sequenceid=23, filesize=5.0 K 2023-11-28 14:55:28,729 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7b2311d47e8559d20609d4cfb34d2d49 in 1653ms, sequenceid=23, compaction requested=true 2023-11-28 14:55:28,729 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:28,729 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:28,729 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:28,729 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:28,729 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,730 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-28 14:55:28,730 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-28 14:55:28,731 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,731 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:28,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:28,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:28,732 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:28,732 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:28,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:28,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:28,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:28,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:28,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-28 14:55:28,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c1b737[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:28,733 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-28 14:55:28,733 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:28,735 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:28,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:28,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:28,735 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-28 14:55:28,735 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-28 14:55:28,735 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:28,735 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,735 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:28,738 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-28 14:55:28,738 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:28,738 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,738 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-28 14:55:28,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:28,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:28,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:28,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:28,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:28,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:28,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:28,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-28 14:55:28,740 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-28 14:55:28,740 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:28,740 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:28,740 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-28 14:55:28,740 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:28,742 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:28,742 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:28,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:28,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:28,742 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:28,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:28,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:28,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:28,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:28,743 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:28,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:28,744 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-28 14:55:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,746 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,746 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:28,746 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-28 14:55:28,746 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:28,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:28,746 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:28,746 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:28,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-28 14:55:28,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-28 14:55:28,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:28,747 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:28,747 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:28,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:28,747 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-28 14:55:28,747 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:28,747 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:28,747 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-28 14:55:28,847 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:28,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:28,848 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:28,848 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 1bb70c27ff1b18e08e734bf4055ade3d/family1 is initiating major compaction (all files) 2023-11-28 14:55:28,849 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:28,849 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:28,849 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 1bb70c27ff1b18e08e734bf4055ade3d/family1 in ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:28,849 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/317866f79a23480c87b0c696597bcf91, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/dc48933a776e449c8c8a24faa10193ea, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/bf6e6c6efdc54e458c6c4f22057fc565, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/b4f6ebfdf4424d7bb4eae619056f2f28, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/58d3f4c89b744fd9b6d689dfbf91e0a6] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp, totalSize=26.6 K 2023-11-28 14:55:28,849 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 317866f79a23480c87b0c696597bcf91, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183320537 2023-11-28 14:55:28,850 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting dc48933a776e449c8c8a24faa10193ea, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183321982 2023-11-28 14:55:28,850 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting bf6e6c6efdc54e458c6c4f22057fc565, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183323791 2023-11-28 14:55:28,850 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting b4f6ebfdf4424d7bb4eae619056f2f28, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183325197 2023-11-28 14:55:28,851 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 58d3f4c89b744fd9b6d689dfbf91e0a6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:55:28,860 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 1bb70c27ff1b18e08e734bf4055ade3d#family1#compaction#148 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:29,268 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023112899e362a409224112b74d9d1e3da24a1a_del 2023-11-28 14:55:29,268 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112899e362a409224112b74d9d1e3da24a1a_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112899e362a409224112b74d9d1e3da24a1a_del 2023-11-28 14:55:29,280 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f26ad87193994ba98a9d8856a202b930 2023-11-28 14:55:29,281 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family1/f26ad87193994ba98a9d8856a202b930 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/f26ad87193994ba98a9d8856a202b930 2023-11-28 14:55:29,285 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f26ad87193994ba98a9d8856a202b930 2023-11-28 14:55:29,285 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1bb70c27ff1b18e08e734bf4055ade3d/family1 of 1bb70c27ff1b18e08e734bf4055ade3d into f26ad87193994ba98a9d8856a202b930(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:29,285 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:29,286 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:29,286 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 1bb70c27ff1b18e08e734bf4055ade3d/family2 is initiating major compaction (all files) 2023-11-28 14:55:29,286 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:29,286 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:29,287 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 1bb70c27ff1b18e08e734bf4055ade3d/family2 in ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:55:29,287 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/a311540e46d34416abe80ac513ff86da, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/b29e44e05fb34dfbaa3bf7cfeab200dc, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/2fd6a1034489483bbd4d3c7d6f124d81, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/5c4c7fcaa0b34a2a87c51da9358e2240, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/9966c0e2dfec48658aa08ca09480fc51] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp, totalSize=25.3 K 2023-11-28 14:55:29,287 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting a311540e46d34416abe80ac513ff86da, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183320537 2023-11-28 14:55:29,287 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting b29e44e05fb34dfbaa3bf7cfeab200dc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183321982 2023-11-28 14:55:29,288 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 2fd6a1034489483bbd4d3c7d6f124d81, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183323791 2023-11-28 14:55:29,288 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 5c4c7fcaa0b34a2a87c51da9358e2240, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183325197 2023-11-28 14:55:29,288 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 9966c0e2dfec48658aa08ca09480fc51, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:55:29,296 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 1bb70c27ff1b18e08e734bf4055ade3d#family2#compaction#149 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:29,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/317866f79a23480c87b0c696597bcf91, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/dc48933a776e449c8c8a24faa10193ea, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/bf6e6c6efdc54e458c6c4f22057fc565, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/b4f6ebfdf4424d7bb4eae619056f2f28, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/58d3f4c89b744fd9b6d689dfbf91e0a6] to archive 2023-11-28 14:55:29,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:29,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/317866f79a23480c87b0c696597bcf91 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/317866f79a23480c87b0c696597bcf91 2023-11-28 14:55:29,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/dc48933a776e449c8c8a24faa10193ea to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/dc48933a776e449c8c8a24faa10193ea 2023-11-28 14:55:29,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/bf6e6c6efdc54e458c6c4f22057fc565 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/bf6e6c6efdc54e458c6c4f22057fc565 2023-11-28 14:55:29,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/b4f6ebfdf4424d7bb4eae619056f2f28 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/b4f6ebfdf4424d7bb4eae619056f2f28 2023-11-28 14:55:29,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/58d3f4c89b744fd9b6d689dfbf91e0a6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/58d3f4c89b744fd9b6d689dfbf91e0a6 2023-11-28 14:55:29,705 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231128eeab669a148249e6841d58c96ede7135_del 2023-11-28 14:55:29,705 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128eeab669a148249e6841d58c96ede7135_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231128eeab669a148249e6841d58c96ede7135_del 2023-11-28 14:55:30,518 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for faf9f6ee4af648eead787be285f256ff 2023-11-28 14:55:30,519 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/.tmp/family2/faf9f6ee4af648eead787be285f256ff as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/faf9f6ee4af648eead787be285f256ff 2023-11-28 14:55:30,523 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for faf9f6ee4af648eead787be285f256ff 2023-11-28 14:55:30,524 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1bb70c27ff1b18e08e734bf4055ade3d/family2 of 1bb70c27ff1b18e08e734bf4055ade3d into faf9f6ee4af648eead787be285f256ff(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:30,524 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:30,524 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:30,524 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 7b2311d47e8559d20609d4cfb34d2d49/family1 is initiating major compaction (all files) 2023-11-28 14:55:30,524 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:30,524 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:30,524 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 7b2311d47e8559d20609d4cfb34d2d49/family1 in ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:30,524 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/bc1b56985a3c42f2ad7c431ad6fdaaab, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/15035000c3ed44028171951ce2456d3e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/7c83175141a44d8584d362040da5412e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/6ad690ce73d7429a8900c0991c6151c5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/b66ea15df2ce40df863f840401b99f57] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp, totalSize=26.6 K 2023-11-28 14:55:30,525 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting bc1b56985a3c42f2ad7c431ad6fdaaab, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183320538 2023-11-28 14:55:30,525 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 15035000c3ed44028171951ce2456d3e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183321983 2023-11-28 14:55:30,526 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 7c83175141a44d8584d362040da5412e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183323791 2023-11-28 14:55:30,526 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 6ad690ce73d7429a8900c0991c6151c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183325198 2023-11-28 14:55:30,526 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting b66ea15df2ce40df863f840401b99f57, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:55:30,537 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 7b2311d47e8559d20609d4cfb34d2d49#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:30,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/a311540e46d34416abe80ac513ff86da, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/b29e44e05fb34dfbaa3bf7cfeab200dc, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/2fd6a1034489483bbd4d3c7d6f124d81, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/5c4c7fcaa0b34a2a87c51da9358e2240, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/9966c0e2dfec48658aa08ca09480fc51] to archive 2023-11-28 14:55:30,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:30,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/a311540e46d34416abe80ac513ff86da to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/a311540e46d34416abe80ac513ff86da 2023-11-28 14:55:30,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/b29e44e05fb34dfbaa3bf7cfeab200dc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/b29e44e05fb34dfbaa3bf7cfeab200dc 2023-11-28 14:55:30,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/2fd6a1034489483bbd4d3c7d6f124d81 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/2fd6a1034489483bbd4d3c7d6f124d81 2023-11-28 14:55:30,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/5c4c7fcaa0b34a2a87c51da9358e2240 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/5c4c7fcaa0b34a2a87c51da9358e2240 2023-11-28 14:55:30,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/9966c0e2dfec48658aa08ca09480fc51 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family2/9966c0e2dfec48658aa08ca09480fc51 2023-11-28 14:55:30,945 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231128590211d5ffd6443a9fc741e086006f05_del 2023-11-28 14:55:30,945 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128590211d5ffd6443a9fc741e086006f05_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231128590211d5ffd6443a9fc741e086006f05_del 2023-11-28 14:55:31,358 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e00d28d15744aaeabb2a352538939f7 2023-11-28 14:55:31,359 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family1/9e00d28d15744aaeabb2a352538939f7 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/9e00d28d15744aaeabb2a352538939f7 2023-11-28 14:55:31,362 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e00d28d15744aaeabb2a352538939f7 2023-11-28 14:55:31,363 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b2311d47e8559d20609d4cfb34d2d49/family1 of 7b2311d47e8559d20609d4cfb34d2d49 into 9e00d28d15744aaeabb2a352538939f7(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:31,363 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:31,363 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:31,363 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 7b2311d47e8559d20609d4cfb34d2d49/family2 is initiating major compaction (all files) 2023-11-28 14:55:31,363 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:31,363 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:31,364 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 7b2311d47e8559d20609d4cfb34d2d49/family2 in ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:55:31,364 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/126bcef1f6354932a0c0ac1fcfba4a0c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/951ebba79358421ea836fbed91c8dad8, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/4f43f7f61efe4d90967306f806b6f285, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/46e8cd2ee8cc447facfc1721792b3201, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/41f17b44a03d46f1899db6386ba46f55] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp, totalSize=25.3 K 2023-11-28 14:55:31,364 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 126bcef1f6354932a0c0ac1fcfba4a0c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183320538 2023-11-28 14:55:31,365 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 951ebba79358421ea836fbed91c8dad8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183321983 2023-11-28 14:55:31,365 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 4f43f7f61efe4d90967306f806b6f285, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183323791 2023-11-28 14:55:31,365 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 46e8cd2ee8cc447facfc1721792b3201, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183325198 2023-11-28 14:55:31,365 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 41f17b44a03d46f1899db6386ba46f55, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:55:31,373 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 7b2311d47e8559d20609d4cfb34d2d49#family2#compaction#151 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:31,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/bc1b56985a3c42f2ad7c431ad6fdaaab, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/15035000c3ed44028171951ce2456d3e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/7c83175141a44d8584d362040da5412e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/6ad690ce73d7429a8900c0991c6151c5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/b66ea15df2ce40df863f840401b99f57] to archive 2023-11-28 14:55:31,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:31,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/bc1b56985a3c42f2ad7c431ad6fdaaab to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/bc1b56985a3c42f2ad7c431ad6fdaaab 2023-11-28 14:55:31,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/15035000c3ed44028171951ce2456d3e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/15035000c3ed44028171951ce2456d3e 2023-11-28 14:55:31,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/7c83175141a44d8584d362040da5412e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/7c83175141a44d8584d362040da5412e 2023-11-28 14:55:31,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/6ad690ce73d7429a8900c0991c6151c5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/6ad690ce73d7429a8900c0991c6151c5 2023-11-28 14:55:31,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/b66ea15df2ce40df863f840401b99f57 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/b66ea15df2ce40df863f840401b99f57 2023-11-28 14:55:31,780 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112810bd7ca340444ca28c12ca736348b812_del 2023-11-28 14:55:31,780 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112810bd7ca340444ca28c12ca736348b812_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023112810bd7ca340444ca28c12ca736348b812_del 2023-11-28 14:55:32,593 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3932c53813784498a08484989dbf972f 2023-11-28 14:55:32,594 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/.tmp/family2/3932c53813784498a08484989dbf972f as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/3932c53813784498a08484989dbf972f 2023-11-28 14:55:32,598 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3932c53813784498a08484989dbf972f 2023-11-28 14:55:32,598 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b2311d47e8559d20609d4cfb34d2d49/family2 of 7b2311d47e8559d20609d4cfb34d2d49 into 3932c53813784498a08484989dbf972f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:32,598 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:32,599 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:32,599 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 1cefad5833bb4721eba3b87e37e62e55/family1 is initiating major compaction (all files) 2023-11-28 14:55:32,599 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:32,599 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:32,599 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 1cefad5833bb4721eba3b87e37e62e55/family1 in ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:32,599 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/cfa07e39bfab46a18760bed7d34aebc7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/841b0660e4ed41f4aa07e5a78300a070, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/ba3061ead38d4c1788391c3c038fecb1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/1e27a003ea4649e595703ced472b7ac9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/3aac79db74044685a5608c653c565696] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp, totalSize=26.6 K 2023-11-28 14:55:32,599 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting cfa07e39bfab46a18760bed7d34aebc7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183320538 2023-11-28 14:55:32,600 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 841b0660e4ed41f4aa07e5a78300a070, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183321982 2023-11-28 14:55:32,600 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting ba3061ead38d4c1788391c3c038fecb1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183323791 2023-11-28 14:55:32,600 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 1e27a003ea4649e595703ced472b7ac9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183325198 2023-11-28 14:55:32,601 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 3aac79db74044685a5608c653c565696, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:55:32,612 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 1cefad5833bb4721eba3b87e37e62e55#family1#compaction#152 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:32,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/126bcef1f6354932a0c0ac1fcfba4a0c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/951ebba79358421ea836fbed91c8dad8, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/4f43f7f61efe4d90967306f806b6f285, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/46e8cd2ee8cc447facfc1721792b3201, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/41f17b44a03d46f1899db6386ba46f55] to archive 2023-11-28 14:55:32,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:32,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/126bcef1f6354932a0c0ac1fcfba4a0c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/126bcef1f6354932a0c0ac1fcfba4a0c 2023-11-28 14:55:32,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/951ebba79358421ea836fbed91c8dad8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/951ebba79358421ea836fbed91c8dad8 2023-11-28 14:55:32,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/4f43f7f61efe4d90967306f806b6f285 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/4f43f7f61efe4d90967306f806b6f285 2023-11-28 14:55:32,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/46e8cd2ee8cc447facfc1721792b3201 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/46e8cd2ee8cc447facfc1721792b3201 2023-11-28 14:55:32,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/41f17b44a03d46f1899db6386ba46f55 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family2/41f17b44a03d46f1899db6386ba46f55 2023-11-28 14:55:33,020 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231128a4affd1b0e0a4ce6826606c80e6bd8f6_del 2023-11-28 14:55:33,020 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128a4affd1b0e0a4ce6826606c80e6bd8f6_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231128a4affd1b0e0a4ce6826606c80e6bd8f6_del 2023-11-28 14:55:33,833 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0ff7259d6ee4140b70f0e990c7fcee7 2023-11-28 14:55:33,833 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family1/a0ff7259d6ee4140b70f0e990c7fcee7 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/a0ff7259d6ee4140b70f0e990c7fcee7 2023-11-28 14:55:33,837 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0ff7259d6ee4140b70f0e990c7fcee7 2023-11-28 14:55:33,838 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1cefad5833bb4721eba3b87e37e62e55/family1 of 1cefad5833bb4721eba3b87e37e62e55 into a0ff7259d6ee4140b70f0e990c7fcee7(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:33,839 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:33,839 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:33,839 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 1cefad5833bb4721eba3b87e37e62e55/family2 is initiating major compaction (all files) 2023-11-28 14:55:33,839 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:33,839 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:33,839 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 1cefad5833bb4721eba3b87e37e62e55/family2 in ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:55:33,839 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/40426983fbaa42b699700356f450d238, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/a95d3fb4fcaf43b7a72ccdf3814dfa1c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/06298cbda7fc4b36a9d328fd37a508b6, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/abcfc1bd4a254f5587d3c77a74ac4790, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/b549c706bed949a69e2cb06ae991fe9a] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp, totalSize=25.3 K 2023-11-28 14:55:33,840 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 40426983fbaa42b699700356f450d238, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183320538 2023-11-28 14:55:33,840 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting a95d3fb4fcaf43b7a72ccdf3814dfa1c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183321982 2023-11-28 14:55:33,840 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 06298cbda7fc4b36a9d328fd37a508b6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183323791 2023-11-28 14:55:33,841 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting abcfc1bd4a254f5587d3c77a74ac4790, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183325198 2023-11-28 14:55:33,841 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting b549c706bed949a69e2cb06ae991fe9a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:55:33,849 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 1cefad5833bb4721eba3b87e37e62e55#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:33,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/cfa07e39bfab46a18760bed7d34aebc7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/841b0660e4ed41f4aa07e5a78300a070, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/ba3061ead38d4c1788391c3c038fecb1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/1e27a003ea4649e595703ced472b7ac9, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/3aac79db74044685a5608c653c565696] to archive 2023-11-28 14:55:33,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:33,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/cfa07e39bfab46a18760bed7d34aebc7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/cfa07e39bfab46a18760bed7d34aebc7 2023-11-28 14:55:33,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/841b0660e4ed41f4aa07e5a78300a070 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/841b0660e4ed41f4aa07e5a78300a070 2023-11-28 14:55:33,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/ba3061ead38d4c1788391c3c038fecb1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/ba3061ead38d4c1788391c3c038fecb1 2023-11-28 14:55:33,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/1e27a003ea4649e595703ced472b7ac9 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/1e27a003ea4649e595703ced472b7ac9 2023-11-28 14:55:33,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/3aac79db74044685a5608c653c565696 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/3aac79db74044685a5608c653c565696 2023-11-28 14:55:34,257 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231128bc246ad96dab4d73a6d0b8b120c9c942_del 2023-11-28 14:55:34,257 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128bc246ad96dab4d73a6d0b8b120c9c942_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231128bc246ad96dab4d73a6d0b8b120c9c942_del 2023-11-28 14:55:35,071 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2af39b3cc4547108980ee0c49a84726 2023-11-28 14:55:35,071 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/.tmp/family2/c2af39b3cc4547108980ee0c49a84726 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/c2af39b3cc4547108980ee0c49a84726 2023-11-28 14:55:35,075 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2af39b3cc4547108980ee0c49a84726 2023-11-28 14:55:35,076 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1cefad5833bb4721eba3b87e37e62e55/family2 of 1cefad5833bb4721eba3b87e37e62e55 into c2af39b3cc4547108980ee0c49a84726(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:35,076 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:35,080 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:35,083 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:35,086 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:35,087 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:35,093 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-28 14:55:35,108 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-28 14:55:35,112 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023112899e362a409224112b74d9d1e3da24a1a_del 2023-11-28 14:55:35,115 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231128a4affd1b0e0a4ce6826606c80e6bd8f6_del 2023-11-28 14:55:35,118 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231128590211d5ffd6443a9fc741e086006f05_del 2023-11-28 14:55:35,118 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-28 14:55:35,119 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(139): Connect 0x50dbf78e to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:55:35,124 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15064be3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:55:35,125 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231128 for table='ns:testMinorCompaction' and column='family1' 2023-11-28 14:55:35,125 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231128 for table='ns:testMinorCompaction' and column='family1' 2023-11-28 14:55:35,125 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231128 for table='ns:testMinorCompaction' and column='family1' 2023-11-28 14:55:35,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/40426983fbaa42b699700356f450d238, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/a95d3fb4fcaf43b7a72ccdf3814dfa1c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/06298cbda7fc4b36a9d328fd37a508b6, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/abcfc1bd4a254f5587d3c77a74ac4790, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/b549c706bed949a69e2cb06ae991fe9a] to archive 2023-11-28 14:55:35,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:35,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/40426983fbaa42b699700356f450d238 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/40426983fbaa42b699700356f450d238 2023-11-28 14:55:35,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/a95d3fb4fcaf43b7a72ccdf3814dfa1c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/a95d3fb4fcaf43b7a72ccdf3814dfa1c 2023-11-28 14:55:35,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/06298cbda7fc4b36a9d328fd37a508b6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/06298cbda7fc4b36a9d328fd37a508b6 2023-11-28 14:55:35,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/abcfc1bd4a254f5587d3c77a74ac4790 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/abcfc1bd4a254f5587d3c77a74ac4790 2023-11-28 14:55:35,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/b549c706bed949a69e2cb06ae991fe9a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family2/b549c706bed949a69e2cb06ae991fe9a 2023-11-28 14:55:35,562 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128120afd8f72784d488517da4ecb8b87e8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231128120afd8f72784d488517da4ecb8b87e8 2023-11-28 14:55:35,562 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128099c162e16f247d3ae0bb4e56cc24018 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231128099c162e16f247d3ae0bb4e56cc24018 2023-11-28 14:55:35,563 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231128 table='ns:testMinorCompaction' column='family1' 2023-11-28 14:55:35,563 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='ns:testMinorCompaction' column='family1' 2023-11-28 14:55:35,581 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:55:35,584 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:55:35,590 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:55:35,593 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:55:35,605 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231128/family1/58aaeb7a42644dad95dc2944fe37f159 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-28 14:55:35,606 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231128/family1/58aaeb7a42644dad95dc2944fe37f159}] 2023-11-28 14:55:35,606 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231128/family1/ceefc360d7994e18aa0b35a8189bea9d first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-28 14:55:35,607 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231128/family1/ceefc360d7994e18aa0b35a8189bea9d}] 2023-11-28 14:55:35,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231128/family1/58aaeb7a42644dad95dc2944fe37f159 for inclusion in 1cefad5833bb4721eba3b87e37e62e55/family1 2023-11-28 14:55:35,615 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231128/family1/ceefc360d7994e18aa0b35a8189bea9d for inclusion in 7b2311d47e8559d20609d4cfb34d2d49/family1 2023-11-28 14:55:35,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-28 14:55:35,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-28 14:55:35,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-28 14:55:35,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-28 14:55:35,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:55:35,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:55:35,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231128/family1/58aaeb7a42644dad95dc2944fe37f159 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__826q5uar390h2rq42p4k2f1rd8ucald4si04bbib3rlsv5c2pvj22icrr60isjnm/family1/58aaeb7a42644dad95dc2944fe37f159 2023-11-28 14:55:35,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231128/family1/ceefc360d7994e18aa0b35a8189bea9d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__42ds59qkf1ir3ltbnqf1gidpj31ke8dpfksahknv3lrbpfrdt1najsoqp0u0elgt/family1/ceefc360d7994e18aa0b35a8189bea9d 2023-11-28 14:55:35,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__826q5uar390h2rq42p4k2f1rd8ucald4si04bbib3rlsv5c2pvj22icrr60isjnm/family1/58aaeb7a42644dad95dc2944fe37f159 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/41558701a12e476f8953a8247f76f819_SeqId_28_ 2023-11-28 14:55:35,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__42ds59qkf1ir3ltbnqf1gidpj31ke8dpfksahknv3lrbpfrdt1najsoqp0u0elgt/family1/ceefc360d7994e18aa0b35a8189bea9d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/540899fde66a48b1b1a00feeea60577b_SeqId_28_ 2023-11-28 14:55:35,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__826q5uar390h2rq42p4k2f1rd8ucald4si04bbib3rlsv5c2pvj22icrr60isjnm/family1/58aaeb7a42644dad95dc2944fe37f159 into 1cefad5833bb4721eba3b87e37e62e55/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/41558701a12e476f8953a8247f76f819_SeqId_28_ - updating store file list. 2023-11-28 14:55:35,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__42ds59qkf1ir3ltbnqf1gidpj31ke8dpfksahknv3lrbpfrdt1najsoqp0u0elgt/family1/ceefc360d7994e18aa0b35a8189bea9d into 7b2311d47e8559d20609d4cfb34d2d49/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/540899fde66a48b1b1a00feeea60577b_SeqId_28_ - updating store file list. 2023-11-28 14:55:35,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/41558701a12e476f8953a8247f76f819_SeqId_28_ into 1cefad5833bb4721eba3b87e37e62e55/family1 2023-11-28 14:55:35,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__826q5uar390h2rq42p4k2f1rd8ucald4si04bbib3rlsv5c2pvj22icrr60isjnm/family1/58aaeb7a42644dad95dc2944fe37f159 into 1cefad5833bb4721eba3b87e37e62e55/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/family1/41558701a12e476f8953a8247f76f819_SeqId_28_) 2023-11-28 14:55:35,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/540899fde66a48b1b1a00feeea60577b_SeqId_28_ into 7b2311d47e8559d20609d4cfb34d2d49/family1 2023-11-28 14:55:35,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__42ds59qkf1ir3ltbnqf1gidpj31ke8dpfksahknv3lrbpfrdt1najsoqp0u0elgt/family1/ceefc360d7994e18aa0b35a8189bea9d into 7b2311d47e8559d20609d4cfb34d2d49/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/family1/540899fde66a48b1b1a00feeea60577b_SeqId_28_) 2023-11-28 14:55:35,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__826q5uar390h2rq42p4k2f1rd8ucald4si04bbib3rlsv5c2pvj22icrr60isjnm/family1/58aaeb7a42644dad95dc2944fe37f159 2023-11-28 14:55:35,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__42ds59qkf1ir3ltbnqf1gidpj31ke8dpfksahknv3lrbpfrdt1najsoqp0u0elgt/family1/ceefc360d7994e18aa0b35a8189bea9d 2023-11-28 14:55:35,627 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231128 table='ns:testMinorCompaction' column='family1' 2023-11-28 14:55:35,627 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='ns:testMinorCompaction' column='family1' 2023-11-28 14:55:35,628 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:35,628 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:35,629 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311289bf2f44e552c458fbe9ec08810d01d38 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311289bf2f44e552c458fbe9ec08810d01d38 2023-11-28 14:55:35,629 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-28 14:55:35,629 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231128' 2023-11-28 14:55:35,629 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231128c74f7065333f4579929e7f53efe8c568 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231128c74f7065333f4579929e7f53efe8c568 2023-11-28 14:55:35,629 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-28 14:55:35,629 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231128' 2023-11-28 14:55:35,631 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231128 for table='ns:testMinorCompaction' and column='family1' 2023-11-28 14:55:35,631 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231128 for table='ns:testMinorCompaction' and column='family1' 2023-11-28 14:55:35,958 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128a5086468d1d24e85894bc1317a93177b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231128a5086468d1d24e85894bc1317a93177b 2023-11-28 14:55:35,959 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='ns:testMinorCompaction' column='family1' 2023-11-28 14:55:35,981 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231128/family1/9f74f2bd14b64c2fbe5c959cb4fd0759 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-28 14:55:35,982 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231128/family1/9f74f2bd14b64c2fbe5c959cb4fd0759}] 2023-11-28 14:55:35,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231128/family1/9f74f2bd14b64c2fbe5c959cb4fd0759 for inclusion in 1bb70c27ff1b18e08e734bf4055ade3d/family1 2023-11-28 14:55:35,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-28 14:55:35,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last=1 2023-11-28 14:55:35,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:55:35,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231128/family1/9f74f2bd14b64c2fbe5c959cb4fd0759 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__c51l5253k5a6bgh6emuge8jr8rn4u5fdfss7koi9eae3otcce2negcl035hcr73d/family1/9f74f2bd14b64c2fbe5c959cb4fd0759 2023-11-28 14:55:35,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__c51l5253k5a6bgh6emuge8jr8rn4u5fdfss7koi9eae3otcce2negcl035hcr73d/family1/9f74f2bd14b64c2fbe5c959cb4fd0759 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/c9e1aa49aeff481892e86c283159a996_SeqId_28_ 2023-11-28 14:55:35,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__c51l5253k5a6bgh6emuge8jr8rn4u5fdfss7koi9eae3otcce2negcl035hcr73d/family1/9f74f2bd14b64c2fbe5c959cb4fd0759 into 1bb70c27ff1b18e08e734bf4055ade3d/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/c9e1aa49aeff481892e86c283159a996_SeqId_28_ - updating store file list. 2023-11-28 14:55:35,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/c9e1aa49aeff481892e86c283159a996_SeqId_28_ into 1bb70c27ff1b18e08e734bf4055ade3d/family1 2023-11-28 14:55:35,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__c51l5253k5a6bgh6emuge8jr8rn4u5fdfss7koi9eae3otcce2negcl035hcr73d/family1/9f74f2bd14b64c2fbe5c959cb4fd0759 into 1bb70c27ff1b18e08e734bf4055ade3d/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/family1/c9e1aa49aeff481892e86c283159a996_SeqId_28_) 2023-11-28 14:55:35,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__ns_testMinorCompaction__c51l5253k5a6bgh6emuge8jr8rn4u5fdfss7koi9eae3otcce2negcl035hcr73d/family1/9f74f2bd14b64c2fbe5c959cb4fd0759 2023-11-28 14:55:35,993 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='ns:testMinorCompaction' column='family1' 2023-11-28 14:55:35,993 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:35,994 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231128fc547a489b744097a5531b883ffa40f4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231128fc547a489b744097a5531b883ffa40f4 2023-11-28 14:55:35,994 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-28 14:55:35,994 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231128' 2023-11-28 14:55:35,995 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231128 for table='ns:testMinorCompaction' and column='family1' 2023-11-28 14:55:35,995 INFO [Listener at localhost/45519] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-28 14:55:35,997 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:35,999 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:36,001 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:36,002 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:36,021 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=254 (was 293), OpenFileDescriptor=662 (was 805), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=137 (was 156), ProcessCount=171 (was 171), AvailableMemoryMB=7547 (was 7617) 2023-11-28 14:55:36,035 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=254, OpenFileDescriptor=662, MaxFileDescriptor=60000, SystemLoadAverage=137, ProcessCount=171, AvailableMemoryMB=7546 2023-11-28 14:55:36,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-28 14:55:36,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,040 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:55:36,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-28 14:55:36,041 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:55:36,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-28 14:55:36,042 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce 2023-11-28 14:55:36,042 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce empty. 2023-11-28 14:55:36,043 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce 2023-11-28 14:55:36,043 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-28 14:55:36,050 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-28 14:55:36,050 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 070be3ce089c4943b771f3d4086624ce, NAME => 'testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:55:36,055 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:36,055 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 070be3ce089c4943b771f3d4086624ce, disabling compactions & flushes 2023-11-28 14:55:36,055 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,055 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,055 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. after waiting 0 ms 2023-11-28 14:55:36,055 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,055 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,055 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:36,057 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:55:36,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701183336058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183336058"}]},"ts":"1701183336058"} 2023-11-28 14:55:36,059 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-28 14:55:36,060 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:55:36,060 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183336060"}]},"ts":"1701183336060"} 2023-11-28 14:55:36,061 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-28 14:55:36,065 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=070be3ce089c4943b771f3d4086624ce, ASSIGN}] 2023-11-28 14:55:36,067 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=070be3ce089c4943b771f3d4086624ce, ASSIGN 2023-11-28 14:55:36,068 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=070be3ce089c4943b771f3d4086624ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:55:36,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-28 14:55:36,219 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=070be3ce089c4943b771f3d4086624ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,219 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701183336219"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183336219"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183336219"}]},"ts":"1701183336219"} 2023-11-28 14:55:36,221 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 070be3ce089c4943b771f3d4086624ce, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:36,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-28 14:55:36,372 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 070be3ce089c4943b771f3d4086624ce, NAME => 'testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce.', STARTKEY => '', ENDKEY => ''} 2023-11-28 14:55:36,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 070be3ce089c4943b771f3d4086624ce 2023-11-28 14:55:36,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:36,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 070be3ce089c4943b771f3d4086624ce 2023-11-28 14:55:36,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 070be3ce089c4943b771f3d4086624ce 2023-11-28 14:55:36,377 INFO [StoreOpener-070be3ce089c4943b771f3d4086624ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 070be3ce089c4943b771f3d4086624ce 2023-11-28 14:55:36,379 DEBUG [StoreOpener-070be3ce089c4943b771f3d4086624ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1 2023-11-28 14:55:36,379 DEBUG [StoreOpener-070be3ce089c4943b771f3d4086624ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1 2023-11-28 14:55:36,379 INFO [StoreOpener-070be3ce089c4943b771f3d4086624ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 070be3ce089c4943b771f3d4086624ce columnFamilyName family1 2023-11-28 14:55:36,380 INFO [StoreOpener-070be3ce089c4943b771f3d4086624ce-1] regionserver.HStore(310): Store=070be3ce089c4943b771f3d4086624ce/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:36,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce 2023-11-28 14:55:36,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce 2023-11-28 14:55:36,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 070be3ce089c4943b771f3d4086624ce 2023-11-28 14:55:36,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:55:36,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 070be3ce089c4943b771f3d4086624ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61300980, jitterRate=-0.0865442156791687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-28 14:55:36,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:36,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce., pid=114, masterSystemTime=1701183336372 2023-11-28 14:55:36,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,388 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=070be3ce089c4943b771f3d4086624ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,389 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701183336388"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183336388"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183336388"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183336388"}]},"ts":"1701183336388"} 2023-11-28 14:55:36,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=114, resume processing ppid=113 2023-11-28 14:55:36,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 070be3ce089c4943b771f3d4086624ce, server=jenkins-hbase4.apache.org,41403,1701183201531 in 169 msec 2023-11-28 14:55:36,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=113, resume processing ppid=112 2023-11-28 14:55:36,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=070be3ce089c4943b771f3d4086624ce, ASSIGN in 326 msec 2023-11-28 14:55:36,392 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:55:36,393 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183336393"}]},"ts":"1701183336393"} 2023-11-28 14:55:36,394 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-28 14:55:36,396 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:55:36,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 358 msec 2023-11-28 14:55:36,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-28 14:55:36,644 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-28 14:55:36,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:36,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,664 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:36,664 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:36,664 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:36,664 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:36,665 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,665 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,667 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:36,667 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:36,668 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,668 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,669 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,669 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:36,669 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:36,669 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:36,669 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:36,669 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:36,669 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,669 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:36,670 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-28 14:55:36,690 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f33281d6ce31489ebc00148e6be44560 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f33281d6ce31489ebc00148e6be44560 2023-11-28 14:55:36,693 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/31e09ab2fcac4d6c9848eba652685f8e 2023-11-28 14:55:36,698 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/31e09ab2fcac4d6c9848eba652685f8e as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/31e09ab2fcac4d6c9848eba652685f8e 2023-11-28 14:55:36,702 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/31e09ab2fcac4d6c9848eba652685f8e, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-28 14:55:36,703 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 33ms, sequenceid=5, compaction requested=false 2023-11-28 14:55:36,704 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:36,704 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:36,704 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,704 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:36,704 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:36,704 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,704 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:36,704 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:36,709 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,709 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:36,709 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,709 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:36,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:36,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4679bf86[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:36,711 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:36,711 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,712 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,712 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:36,713 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:36,713 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:36,713 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,713 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:36,714 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:36,714 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,714 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:36,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:36,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:36,714 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:36,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:36,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:36,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:36,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:36,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:36,717 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:36,717 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:36,717 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:36,717 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,717 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:36,721 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,721 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,721 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:36,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:36,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:36,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:36,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:36,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:36,722 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:36,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,723 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:36,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:36,725 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:36,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-28 14:55:36,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:36,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:36,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,725 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:36,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:36,726 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:36,726 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:36,726 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:36,726 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,726 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,726 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:36,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:36,826 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:36,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:36,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:36,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:36,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,832 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:36,832 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:36,832 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:36,832 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:36,833 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,833 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,834 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,834 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:36,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:36,834 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:36,835 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,835 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,835 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:55:36,835 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:36,836 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:36,836 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:36,836 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:36,836 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:36,836 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:36,836 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:36,836 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:36,836 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-28 14:55:37,246 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b836cd0c09974a7a9b5971906eb63b25 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128b836cd0c09974a7a9b5971906eb63b25 2023-11-28 14:55:37,651 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/0448ca6477e64c15b5b325f0e5091f71 2023-11-28 14:55:37,656 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/0448ca6477e64c15b5b325f0e5091f71 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/0448ca6477e64c15b5b325f0e5091f71 2023-11-28 14:55:37,659 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/0448ca6477e64c15b5b325f0e5091f71, entries=1, sequenceid=9, filesize=5.0 K 2023-11-28 14:55:37,660 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 824ms, sequenceid=9, compaction requested=false 2023-11-28 14:55:37,660 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:37,660 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:37,660 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:37,660 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:37,660 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,661 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:37,661 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:37,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,663 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:37,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:37,663 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,664 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:37,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:37,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:37,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:37,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:37,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@396173a7[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:37,665 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:37,665 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,668 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,668 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:37,668 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:37,668 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:37,668 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,668 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:37,670 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:37,670 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,670 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:37,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:37,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:37,670 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:37,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:37,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:37,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:37,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:37,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:37,673 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:37,673 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:37,673 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:37,673 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,673 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:37,674 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,674 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:37,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,675 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:37,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:37,675 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,676 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:37,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,679 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,679 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,679 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,679 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:37,679 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:37,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:37,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:37,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-28 14:55:37,679 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:37,679 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:37,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:37,679 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,680 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:37,680 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,680 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:37,680 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:37,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:37,780 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:37,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:37,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:37,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:37,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,786 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:37,786 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:37,786 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:37,786 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:37,786 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,786 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,788 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,788 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:37,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:37,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:37,789 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:37,789 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,789 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,789 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,790 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:55:37,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:37,790 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:37,790 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:37,790 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:37,790 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:37,790 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:37,790 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:37,790 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:37,790 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:55:38,202 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d6f12ab141a54d5b8967fda3a7dfd1bf to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201d6f12ab141a54d5b8967fda3a7dfd1bf 2023-11-28 14:55:38,607 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/181e65cbb2054a3bb052a9a8bc7ee5b6 2023-11-28 14:55:38,611 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/181e65cbb2054a3bb052a9a8bc7ee5b6 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/181e65cbb2054a3bb052a9a8bc7ee5b6 2023-11-28 14:55:38,614 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/181e65cbb2054a3bb052a9a8bc7ee5b6, entries=1, sequenceid=13, filesize=4.9 K 2023-11-28 14:55:38,615 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 825ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:38,615 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:38,615 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:38,615 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:38,615 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:38,615 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,615 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:38,615 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:38,618 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,618 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:38,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:38,618 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,618 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:38,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:38,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:38,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:38,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:38,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61db9a6[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:38,620 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:38,620 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,621 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,621 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:38,621 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:38,621 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:38,621 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,621 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:38,623 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,623 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:38,623 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:38,623 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:38,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:38,625 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:38,625 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:38,625 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:38,625 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,625 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:38,628 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,628 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,628 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:38,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:38,628 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,629 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,634 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,634 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:38,634 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,634 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:38,634 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:38,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:38,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:38,634 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,635 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,635 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,635 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,635 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,635 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:38,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:38,635 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:38,735 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:38,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:38,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:38,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:38,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,741 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:38,741 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:38,741 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:38,741 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:38,741 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,741 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,743 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:38,743 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:38,743 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:38,743 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:38,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,744 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,744 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:55:38,744 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:38,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:38,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:38,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:38,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:38,744 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:38,744 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:38,744 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:38,744 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:55:39,154 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058aca10470b684e9f9a4abeb75460d16b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058aca10470b684e9f9a4abeb75460d16b 2023-11-28 14:55:39,559 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/57d2ce494bd24a95a3745593eed00465 2023-11-28 14:55:39,564 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/57d2ce494bd24a95a3745593eed00465 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/57d2ce494bd24a95a3745593eed00465 2023-11-28 14:55:39,567 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/57d2ce494bd24a95a3745593eed00465, entries=1, sequenceid=17, filesize=4.9 K 2023-11-28 14:55:39,568 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 824ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:39,568 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:39,568 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:39,568 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:39,570 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,570 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:39,571 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,571 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:39,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:39,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f1cce5d[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:39,572 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:39,572 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,575 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:39,575 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,575 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:39,575 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:39,576 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:39,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:39,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:39,579 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:39,579 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:39,579 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:39,579 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,579 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:39,580 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,580 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,580 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:39,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:39,581 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,582 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:39,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,584 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,584 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:39,584 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:39,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:39,584 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:39,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:39,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:39,585 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:39,585 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:39,585 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:39,585 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,585 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:39,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:39,585 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,585 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,585 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,685 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:39,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:39,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:39,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:39,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,691 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:39,691 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:39,691 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:39,691 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:39,691 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,691 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,693 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:39,693 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:39,694 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:39,694 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,694 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,695 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:55:39,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:39,695 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:39,695 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:39,695 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:39,695 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:39,695 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:39,695 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:39,695 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:39,695 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:55:40,106 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282a10e711dcd241a6be951fea0d275e2c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512282a10e711dcd241a6be951fea0d275e2c 2023-11-28 14:55:40,512 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/2b894e33f06c402b88d89673347eb66a 2023-11-28 14:55:40,516 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/2b894e33f06c402b88d89673347eb66a as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/2b894e33f06c402b88d89673347eb66a 2023-11-28 14:55:40,519 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/2b894e33f06c402b88d89673347eb66a, entries=1, sequenceid=21, filesize=4.9 K 2023-11-28 14:55:40,520 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 825ms, sequenceid=21, compaction requested=true 2023-11-28 14:55:40,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:40,520 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:40,520 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:40,522 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:40,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:40,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,522 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:40,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:40,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:40,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7492cbb7[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:40,524 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:40,524 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,525 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,525 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:40,525 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:40,525 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:40,525 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,525 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:40,527 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:40,527 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,527 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:40,527 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:40,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:40,529 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:40,529 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:40,529 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:40,529 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,529 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:40,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:40,536 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,536 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:40,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,537 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:40,539 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:40,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-28 14:55:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:40,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:40,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:40,540 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:40,540 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,540 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:40,540 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,540 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,540 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,540 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:40,540 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:40,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:40,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:40,640 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:40,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:40,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:40,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:40,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,646 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:40,646 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:40,646 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:40,646 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:40,647 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,647 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,648 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,648 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:40,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:40,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:40,649 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:40,649 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:40,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,649 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,650 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:55:40,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:40,650 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:40,650 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:40,650 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:40,650 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:40,650 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:40,650 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:40,650 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:40,650 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:55:41,061 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e1f6bac5ef984985b7610345b1631ff3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e1f6bac5ef984985b7610345b1631ff3 2023-11-28 14:55:41,467 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/633e9491476c49709b4e34950e50cd54 2023-11-28 14:55:41,472 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/633e9491476c49709b4e34950e50cd54 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/633e9491476c49709b4e34950e50cd54 2023-11-28 14:55:41,475 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/633e9491476c49709b4e34950e50cd54, entries=1, sequenceid=25, filesize=4.9 K 2023-11-28 14:55:41,476 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 826ms, sequenceid=25, compaction requested=true 2023-11-28 14:55:41,476 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:41,476 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:41,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:41,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:41,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:41,476 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:41,478 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,478 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,479 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,479 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:41,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:41,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@465c72c9[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:41,481 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:41,481 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,483 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,483 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:41,483 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:41,484 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:41,484 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,484 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:41,485 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:41,485 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,485 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,485 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:41,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:41,488 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:41,489 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:41,489 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:41,489 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,489 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:41,495 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,495 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,495 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:41,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:41,496 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,497 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,499 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,499 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:41,499 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:41,499 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:41,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-28 14:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:41,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:41,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:41,499 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,499 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:41,499 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,500 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,500 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,500 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:41,500 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:41,500 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:41,600 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:41,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:41,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:41,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:41,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,607 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:41,607 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:41,607 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:41,607 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:41,608 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,608 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,609 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,609 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:41,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:41,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:41,610 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,610 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:41,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:41,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,611 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,611 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:55:41,611 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,612 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:41,612 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:41,612 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:41,616 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:41,616 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:41,616 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:41,616 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:41,616 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:55:41,633 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017e14531b1bba4e55a1b36aad4d75b951 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017e14531b1bba4e55a1b36aad4d75b951 2023-11-28 14:55:41,637 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/108cf9221a914ba9aafb93f7c151c798 2023-11-28 14:55:41,641 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/108cf9221a914ba9aafb93f7c151c798 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/108cf9221a914ba9aafb93f7c151c798 2023-11-28 14:55:41,643 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/108cf9221a914ba9aafb93f7c151c798, entries=1, sequenceid=29, filesize=4.9 K 2023-11-28 14:55:41,644 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 28ms, sequenceid=29, compaction requested=true 2023-11-28 14:55:41,644 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:41,644 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,644 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:41,645 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:41,647 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,647 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,648 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:41,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d67232d[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:41,649 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:41,649 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,650 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:41,650 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,651 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:41,650 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:41,652 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,652 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:41,652 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:41,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,652 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:41,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:41,655 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:41,655 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:41,655 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:41,655 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,655 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:41,656 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,656 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,656 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:41,657 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,659 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,663 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:41,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:41,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:41,663 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:41,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:41,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:41,763 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:41,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:41,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:41,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:41,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,769 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:41,770 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:41,770 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:41,770 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:41,770 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,770 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,771 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:41,771 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:41,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:41,772 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,772 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:41,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:41,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,772 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,773 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:55:41,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,773 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:41,773 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:41,773 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:41,773 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:41,773 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:41,773 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:41,773 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:41,773 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:55:41,785 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103286891ad6288428abb7f0c1d9e23dac5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103286891ad6288428abb7f0c1d9e23dac5 2023-11-28 14:55:41,793 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/1225bffbe9e14e439c649078170a7c51 2023-11-28 14:55:41,797 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/1225bffbe9e14e439c649078170a7c51 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1225bffbe9e14e439c649078170a7c51 2023-11-28 14:55:41,800 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1225bffbe9e14e439c649078170a7c51, entries=1, sequenceid=33, filesize=4.9 K 2023-11-28 14:55:41,801 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 28ms, sequenceid=33, compaction requested=true 2023-11-28 14:55:41,801 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:41,801 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:41,803 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,803 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,803 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,803 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:41,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:41,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34907efa[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:41,805 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:41,805 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,806 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,806 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:41,806 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:41,806 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,806 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:41,806 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:41,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:41,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:41,808 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,808 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:41,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:41,811 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:41,811 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:41,811 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:41,811 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,811 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:41,813 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,813 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,813 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:41,814 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,815 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:41,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:41,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-28 14:55:41,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:41,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:41,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:41,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,818 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:41,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:41,818 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:41,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:41,819 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:41,819 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:41,919 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:41,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:41,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:41,924 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:55:41,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:41,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,927 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:41,927 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:41,927 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:41,927 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:41,928 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,928 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,929 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:41,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:41,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:41,930 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,930 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,930 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:41,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:41,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,933 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:55:41,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,940 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:41,940 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:41,940 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:41,941 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:41,941 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:41,941 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:41,941 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:41,941 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:55:41,957 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077bf51873ea214eeb876511c198046257 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509077bf51873ea214eeb876511c198046257 2023-11-28 14:55:41,968 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/1bc62ac9ee154113b85410081b2bbd1c 2023-11-28 14:55:41,979 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/1bc62ac9ee154113b85410081b2bbd1c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1bc62ac9ee154113b85410081b2bbd1c 2023-11-28 14:55:41,984 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1bc62ac9ee154113b85410081b2bbd1c, entries=1, sequenceid=37, filesize=4.9 K 2023-11-28 14:55:41,985 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 44ms, sequenceid=37, compaction requested=true 2023-11-28 14:55:41,985 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:41,985 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:41,985 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:41,985 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:41,985 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,985 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:41,985 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:41,991 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,991 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,991 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,991 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:41,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56bdc4ac[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:41,993 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:41,993 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,994 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,994 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:41,994 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:41,994 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:41,994 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,995 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:41,996 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:41,996 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,996 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:41,996 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:41,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:41,999 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:41,999 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:41,999 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:41,999 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:41,999 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:42,002 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,002 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,002 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:42,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:42,003 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:42,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:42,004 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:42,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,007 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,007 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:42,007 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:42,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:42,007 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:42,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:42,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:42,007 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:42,007 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,007 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,007 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,007 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,007 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,008 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:42,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-28 14:55:42,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:42,008 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:42,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:42,108 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:42,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:42,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:42,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:42,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,114 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:42,114 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:42,114 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-28 14:55:42,114 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-28 14:55:42,115 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,115 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,116 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:42,116 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:42,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:42,117 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,117 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:42,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:42,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,118 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,118 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-28 14:55:42,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-28 14:55:42,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:42,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-28 14:55:42,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-28 14:55:42,118 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:42,118 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:42,118 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. started... 2023-11-28 14:55:42,118 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 070be3ce089c4943b771f3d4086624ce 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-28 14:55:42,529 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120630ab3a928f142509686001dccd674f8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120630ab3a928f142509686001dccd674f8 2023-11-28 14:55:42,935 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/8755f4a7ca15440eb371ea19855e49ca 2023-11-28 14:55:42,939 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/8755f4a7ca15440eb371ea19855e49ca as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8755f4a7ca15440eb371ea19855e49ca 2023-11-28 14:55:42,942 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8755f4a7ca15440eb371ea19855e49ca, entries=1, sequenceid=41, filesize=4.9 K 2023-11-28 14:55:42,943 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 070be3ce089c4943b771f3d4086624ce in 825ms, sequenceid=41, compaction requested=true 2023-11-28 14:55:42,943 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:42,943 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-28 14:55:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-28 14:55:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-28 14:55:42,943 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-28 14:55:42,944 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,945 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:42,945 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,945 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:42,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:42,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-28 14:55:42,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73d22e88[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:42,946 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-28 14:55:42,946 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,948 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,948 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-28 14:55:42,948 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-28 14:55:42,948 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:42,948 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,948 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:42,950 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-28 14:55:42,950 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:42,950 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,950 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-28 14:55:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:42,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:42,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:42,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-28 14:55:42,952 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-28 14:55:42,952 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:42,952 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:42,952 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,952 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:42,954 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,954 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,954 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:42,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:42,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:42,955 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,956 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:42,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,958 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,958 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:42,958 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:42,958 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:42,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:42,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-28 14:55:42,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:42,958 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,958 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:42,959 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:42,959 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,959 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:42,959 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:42,959 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:42,959 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:42,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:43,059 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:43,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:43,061 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-28 14:55:43,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:55:43,064 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:55:43,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:55:43,064 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183943064 2023-11-28 14:55:43,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-28 14:55:43,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-28 14:55:43,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:55:43,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x2ad15e6c to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:55:43,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bf9ad4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:55:43,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:55:43,907 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103aa1104df741547b19d6b87da8fedd742 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103aa1104df741547b19d6b87da8fedd742 2023-11-28 14:55:43,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:55:43,924 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:55:43,926 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:55:43,932 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:55:43,933 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:55:43,941 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7d17fe161de749b7a3cff258c2cf3a9e first=Optional[r5] last=Optional[r6] 2023-11-28 14:55:43,942 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7d17fe161de749b7a3cff258c2cf3a9e}] 2023-11-28 14:55:43,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7d17fe161de749b7a3cff258c2cf3a9e for inclusion in 070be3ce089c4943b771f3d4086624ce/family1 2023-11-28 14:55:43,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-28 14:55:43,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:55:43,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:43,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7d17fe161de749b7a3cff258c2cf3a9e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3k0ktplo9t491864m92tbdorhfod1r5fgmi8138u8n9hs2gn5a96uh4o9gsv17cd/family1/7d17fe161de749b7a3cff258c2cf3a9e 2023-11-28 14:55:43,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3k0ktplo9t491864m92tbdorhfod1r5fgmi8138u8n9hs2gn5a96uh4o9gsv17cd/family1/7d17fe161de749b7a3cff258c2cf3a9e as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/f39a3cb7476842f7bc34db137eec65c0_SeqId_44_ 2023-11-28 14:55:43,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3k0ktplo9t491864m92tbdorhfod1r5fgmi8138u8n9hs2gn5a96uh4o9gsv17cd/family1/7d17fe161de749b7a3cff258c2cf3a9e into 070be3ce089c4943b771f3d4086624ce/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/f39a3cb7476842f7bc34db137eec65c0_SeqId_44_ - updating store file list. 2023-11-28 14:55:43,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/f39a3cb7476842f7bc34db137eec65c0_SeqId_44_ into 070be3ce089c4943b771f3d4086624ce/family1 2023-11-28 14:55:43,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3k0ktplo9t491864m92tbdorhfod1r5fgmi8138u8n9hs2gn5a96uh4o9gsv17cd/family1/7d17fe161de749b7a3cff258c2cf3a9e into 070be3ce089c4943b771f3d4086624ce/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/f39a3cb7476842f7bc34db137eec65c0_SeqId_44_) 2023-11-28 14:55:43,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__3k0ktplo9t491864m92tbdorhfod1r5fgmi8138u8n9hs2gn5a96uh4o9gsv17cd/family1/7d17fe161de749b7a3cff258c2cf3a9e 2023-11-28 14:55:43,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-28 14:55:43,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-28 14:55:43,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): 070be3ce089c4943b771f3d4086624ce/family1 is initiating minor compaction 2023-11-28 14:55:43,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@547c018f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:55:43,983 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 070be3ce089c4943b771f3d4086624ce/family1 in testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:43,984 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/0448ca6477e64c15b5b325f0e5091f71, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/181e65cbb2054a3bb052a9a8bc7ee5b6, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/57d2ce494bd24a95a3745593eed00465, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/2b894e33f06c402b88d89673347eb66a, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/633e9491476c49709b4e34950e50cd54, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/108cf9221a914ba9aafb93f7c151c798, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1225bffbe9e14e439c649078170a7c51, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1bc62ac9ee154113b85410081b2bbd1c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8755f4a7ca15440eb371ea19855e49ca, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/f39a3cb7476842f7bc34db137eec65c0_SeqId_44_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp, totalSize=49.7 K 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 0448ca6477e64c15b5b325f0e5091f71, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 181e65cbb2054a3bb052a9a8bc7ee5b6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 57d2ce494bd24a95a3745593eed00465, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 2b894e33f06c402b88d89673347eb66a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 633e9491476c49709b4e34950e50cd54, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 108cf9221a914ba9aafb93f7c151c798, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 1225bffbe9e14e439c649078170a7c51, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 1bc62ac9ee154113b85410081b2bbd1c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting 8755f4a7ca15440eb371ea19855e49ca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-28 14:55:43,984 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] compactions.Compactor(207): Compacting f39a3cb7476842f7bc34db137eec65c0_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-28 14:55:43,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:55:43,988 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:43,990 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017e14531b1bba4e55a1b36aad4d75b951 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017e14531b1bba4e55a1b36aad4d75b951 2023-11-28 14:55:43,991 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103286891ad6288428abb7f0c1d9e23dac5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103286891ad6288428abb7f0c1d9e23dac5 2023-11-28 14:55:43,991 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-28 14:55:43,991 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-28 14:55:43,992 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:55:43,992 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:55:44,039 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] throttle.PressureAwareThroughputController(145): 070be3ce089c4943b771f3d4086624ce#family1#compaction#164 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:44,459 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/c72e5c0447ea4c53bcf2555ec5d2c534 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/c72e5c0447ea4c53bcf2555ec5d2c534 2023-11-28 14:55:44,467 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d854fb438be142e487ed7d04a398108a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d854fb438be142e487ed7d04a398108a 2023-11-28 14:55:44,472 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 070be3ce089c4943b771f3d4086624ce/family1 of 070be3ce089c4943b771f3d4086624ce into c72e5c0447ea4c53bcf2555ec5d2c534(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:44,472 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:44,472 INFO [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1701183343983; duration=0sec 2023-11-28 14:55:44,472 DEBUG [RS:0;jenkins-hbase4:41403-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:55:44,473 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:55:44,501 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/de52f944d4b74118b2b2bdad887d4606 first=Optional[r1] last=Optional[r4] 2023-11-28 14:55:44,506 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/de52f944d4b74118b2b2bdad887d4606}] 2023-11-28 14:55:44,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/de52f944d4b74118b2b2bdad887d4606 for inclusion in 070be3ce089c4943b771f3d4086624ce/family1 2023-11-28 14:55:44,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-28 14:55:44,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:55:44,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:44,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/de52f944d4b74118b2b2bdad887d4606 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j8cqev859ml465qo5mmca6bvsbq29i360lq6dgd6so4aupdd4034ihk08g4r9he7/family1/de52f944d4b74118b2b2bdad887d4606 2023-11-28 14:55:44,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j8cqev859ml465qo5mmca6bvsbq29i360lq6dgd6so4aupdd4034ihk08g4r9he7/family1/de52f944d4b74118b2b2bdad887d4606 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8cb2879e86784fdc8545b93de027eaf9_SeqId_47_ 2023-11-28 14:55:44,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j8cqev859ml465qo5mmca6bvsbq29i360lq6dgd6so4aupdd4034ihk08g4r9he7/family1/de52f944d4b74118b2b2bdad887d4606 into 070be3ce089c4943b771f3d4086624ce/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8cb2879e86784fdc8545b93de027eaf9_SeqId_47_ - updating store file list. 2023-11-28 14:55:44,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8cb2879e86784fdc8545b93de027eaf9_SeqId_47_ into 070be3ce089c4943b771f3d4086624ce/family1 2023-11-28 14:55:44,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j8cqev859ml465qo5mmca6bvsbq29i360lq6dgd6so4aupdd4034ihk08g4r9he7/family1/de52f944d4b74118b2b2bdad887d4606 into 070be3ce089c4943b771f3d4086624ce/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8cb2879e86784fdc8545b93de027eaf9_SeqId_47_) 2023-11-28 14:55:44,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j8cqev859ml465qo5mmca6bvsbq29i360lq6dgd6so4aupdd4034ihk08g4r9he7/family1/de52f944d4b74118b2b2bdad887d4606 2023-11-28 14:55:44,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-28 14:55:44,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-28 14:55:44,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(1912): 070be3ce089c4943b771f3d4086624ce/family1 is initiating minor compaction (all files) 2023-11-28 14:55:44,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@247890c7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:55:44,519 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 070be3ce089c4943b771f3d4086624ce/family1 in testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:55:44,519 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/31e09ab2fcac4d6c9848eba652685f8e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/c72e5c0447ea4c53bcf2555ec5d2c534, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8cb2879e86784fdc8545b93de027eaf9_SeqId_47_] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp, totalSize=178.1 K 2023-11-28 14:55:44,519 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting 31e09ab2fcac4d6c9848eba652685f8e, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824829 2023-11-28 14:55:44,520 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting c72e5c0447ea4c53bcf2555ec5d2c534, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224829 2023-11-28 14:55:44,520 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] compactions.Compactor(207): Compacting 8cb2879e86784fdc8545b93de027eaf9_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224829 2023-11-28 14:55:44,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:55:44,521 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:44,522 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201d6f12ab141a54d5b8967fda3a7dfd1bf to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201d6f12ab141a54d5b8967fda3a7dfd1bf 2023-11-28 14:55:44,523 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058aca10470b684e9f9a4abeb75460d16b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058aca10470b684e9f9a4abeb75460d16b 2023-11-28 14:55:44,524 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512282a10e711dcd241a6be951fea0d275e2c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512282a10e711dcd241a6be951fea0d275e2c 2023-11-28 14:55:44,525 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e1f6bac5ef984985b7610345b1631ff3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e1f6bac5ef984985b7610345b1631ff3 2023-11-28 14:55:44,525 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-28 14:55:44,525 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-28 14:55:44,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:55:44,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:55:44,533 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] throttle.PressureAwareThroughputController(145): 070be3ce089c4943b771f3d4086624ce#family1#compaction#165 average throughput is 25.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:44,555 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/.tmp/family1/61f9f730f99d4dddac3c214e52b51a00 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/61f9f730f99d4dddac3c214e52b51a00 2023-11-28 14:55:44,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/0448ca6477e64c15b5b325f0e5091f71, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/181e65cbb2054a3bb052a9a8bc7ee5b6, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/57d2ce494bd24a95a3745593eed00465, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/2b894e33f06c402b88d89673347eb66a, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/633e9491476c49709b4e34950e50cd54, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/108cf9221a914ba9aafb93f7c151c798, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1225bffbe9e14e439c649078170a7c51, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1bc62ac9ee154113b85410081b2bbd1c, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8755f4a7ca15440eb371ea19855e49ca, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/f39a3cb7476842f7bc34db137eec65c0_SeqId_44_] to archive 2023-11-28 14:55:44,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:44,561 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 070be3ce089c4943b771f3d4086624ce/family1 of 070be3ce089c4943b771f3d4086624ce into 61f9f730f99d4dddac3c214e52b51a00(size=167.7 K), total size for store is 167.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:44,561 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:44,561 INFO [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1701183344519; duration=0sec 2023-11-28 14:55:44,562 DEBUG [RS:0;jenkins-hbase4:41403-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-28 14:55:44,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/0448ca6477e64c15b5b325f0e5091f71 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/0448ca6477e64c15b5b325f0e5091f71 2023-11-28 14:55:44,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/181e65cbb2054a3bb052a9a8bc7ee5b6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/181e65cbb2054a3bb052a9a8bc7ee5b6 2023-11-28 14:55:44,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/57d2ce494bd24a95a3745593eed00465 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/57d2ce494bd24a95a3745593eed00465 2023-11-28 14:55:44,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/2b894e33f06c402b88d89673347eb66a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/2b894e33f06c402b88d89673347eb66a 2023-11-28 14:55:44,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/633e9491476c49709b4e34950e50cd54 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/633e9491476c49709b4e34950e50cd54 2023-11-28 14:55:44,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/108cf9221a914ba9aafb93f7c151c798 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/108cf9221a914ba9aafb93f7c151c798 2023-11-28 14:55:44,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1225bffbe9e14e439c649078170a7c51 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1225bffbe9e14e439c649078170a7c51 2023-11-28 14:55:44,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1bc62ac9ee154113b85410081b2bbd1c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/1bc62ac9ee154113b85410081b2bbd1c 2023-11-28 14:55:44,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8755f4a7ca15440eb371ea19855e49ca to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8755f4a7ca15440eb371ea19855e49ca 2023-11-28 14:55:44,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/f39a3cb7476842f7bc34db137eec65c0_SeqId_44_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/f39a3cb7476842f7bc34db137eec65c0_SeqId_44_ 2023-11-28 14:55:44,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/31e09ab2fcac4d6c9848eba652685f8e, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/c72e5c0447ea4c53bcf2555ec5d2c534, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8cb2879e86784fdc8545b93de027eaf9_SeqId_47_] to archive 2023-11-28 14:55:44,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:44,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/31e09ab2fcac4d6c9848eba652685f8e to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/31e09ab2fcac4d6c9848eba652685f8e 2023-11-28 14:55:44,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/c72e5c0447ea4c53bcf2555ec5d2c534 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/c72e5c0447ea4c53bcf2555ec5d2c534 2023-11-28 14:55:44,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8cb2879e86784fdc8545b93de027eaf9_SeqId_47_ to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/8cb2879e86784fdc8545b93de027eaf9_SeqId_47_ 2023-11-28 14:55:45,381 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a11b500c11504940b291f44ebf743cbc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a11b500c11504940b291f44ebf743cbc 2023-11-28 14:55:45,382 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:55:45,416 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9dea89f9f8aa46109193fa98fcfa563c first=Optional[r00] last=Optional[r8] 2023-11-28 14:55:45,417 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9dea89f9f8aa46109193fa98fcfa563c}] 2023-11-28 14:55:45,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9dea89f9f8aa46109193fa98fcfa563c for inclusion in 070be3ce089c4943b771f3d4086624ce/family1 2023-11-28 14:55:45,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-28 14:55:45,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last= 2023-11-28 14:55:45,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:55:45,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9dea89f9f8aa46109193fa98fcfa563c to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vsaedo6hdg4nfnj4v4gts4311o9qveeja06soh08p7f4b5ica4ivh6pk9bimmvn6/family1/9dea89f9f8aa46109193fa98fcfa563c 2023-11-28 14:55:45,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vsaedo6hdg4nfnj4v4gts4311o9qveeja06soh08p7f4b5ica4ivh6pk9bimmvn6/family1/9dea89f9f8aa46109193fa98fcfa563c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/896de0e5cf6b47aa8abdb7ffc9d23e86_SeqId_50_ 2023-11-28 14:55:45,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vsaedo6hdg4nfnj4v4gts4311o9qveeja06soh08p7f4b5ica4ivh6pk9bimmvn6/family1/9dea89f9f8aa46109193fa98fcfa563c into 070be3ce089c4943b771f3d4086624ce/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/896de0e5cf6b47aa8abdb7ffc9d23e86_SeqId_50_ - updating store file list. 2023-11-28 14:55:45,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/896de0e5cf6b47aa8abdb7ffc9d23e86_SeqId_50_ into 070be3ce089c4943b771f3d4086624ce/family1 2023-11-28 14:55:45,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vsaedo6hdg4nfnj4v4gts4311o9qveeja06soh08p7f4b5ica4ivh6pk9bimmvn6/family1/9dea89f9f8aa46109193fa98fcfa563c into 070be3ce089c4943b771f3d4086624ce/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/family1/896de0e5cf6b47aa8abdb7ffc9d23e86_SeqId_50_) 2023-11-28 14:55:45,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vsaedo6hdg4nfnj4v4gts4311o9qveeja06soh08p7f4b5ica4ivh6pk9bimmvn6/family1/9dea89f9f8aa46109193fa98fcfa563c 2023-11-28 14:55:45,433 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:55:45,434 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:45,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120630ab3a928f142509686001dccd674f8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120630ab3a928f142509686001dccd674f8 2023-11-28 14:55:45,436 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128b836cd0c09974a7a9b5971906eb63b25 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128b836cd0c09974a7a9b5971906eb63b25 2023-11-28 14:55:45,437 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f33281d6ce31489ebc00148e6be44560 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130f33281d6ce31489ebc00148e6be44560 2023-11-28 14:55:45,437 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-28 14:55:45,437 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-28 14:55:45,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:55:45,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:55:45,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-28 14:55:45,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-28 14:55:45,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:55:45,441 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-28 14:55:45,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.3790 sec 2023-11-28 14:55:45,649 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=262 (was 254) - Thread LEAK? -, OpenFileDescriptor=694 (was 662) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 137) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=7689 (was 7546) - AvailableMemoryMB LEAK? - 2023-11-28 14:55:45,660 INFO [Listener at localhost/45519] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=262, OpenFileDescriptor=694, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=171, AvailableMemoryMB=7689 2023-11-28 14:55:45,679 DEBUG [Listener at localhost/45519] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-28 14:55:45,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x107\x94\xD9\x068\x8F\x5C\xE1\x91\xD0\xCE\xAC\x86?\x8DR"\x10\x89\x02'\x1C \x87%\x94\xD5\x02SL\xC6x\x0B\xDD*\x10\xAC\xA9\x99e\xAC\x03\xC1\xCF\xB7hi\xCB\xEF1\x0Ao2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-28 14:55:45,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-28 14:55:45,733 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-28 14:55:45,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-28 14:55:45,734 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-28 14:55:45,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-28 14:55:45,735 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:45,735 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:45,735 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:45,736 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a empty. 2023-11-28 14:55:45,736 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc empty. 2023-11-28 14:55:45,736 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94 empty. 2023-11-28 14:55:45,736 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:45,736 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:45,736 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:45,736 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-28 14:55:45,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-28 14:55:46,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-28 14:55:46,144 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-28 14:55:46,146 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => e7248b483b8790142454233d994c4e7a, NAME => 'testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x107\x94\xD9\x068\x8F\x5C\xE1\x91\xD0\xCE\xAC\x86?\x8DR"\x10\x89\x02'\x1C \x87%\x94\xD5\x02SL\xC6x\x0B\xDD*\x10\xAC\xA9\x99e\xAC\x03\xC1\xCF\xB7hi\xCB\xEF1\x0Ao2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:55:46,146 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => bacbb02533a4cb91b665cdf46a4cb8bc, NAME => 'testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x107\x94\xD9\x068\x8F\x5C\xE1\x91\xD0\xCE\xAC\x86?\x8DR"\x10\x89\x02'\x1C \x87%\x94\xD5\x02SL\xC6x\x0B\xDD*\x10\xAC\xA9\x99e\xAC\x03\xC1\xCF\xB7hi\xCB\xEF1\x0Ao2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:55:46,146 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 66332b88690d2bc7165356ec660f3d94, NAME => 'testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x107\x94\xD9\x068\x8F\x5C\xE1\x91\xD0\xCE\xAC\x86?\x8DR"\x10\x89\x02'\x1C \x87%\x94\xD5\x02SL\xC6x\x0B\xDD*\x10\xAC\xA9\x99e\xAC\x03\xC1\xCF\xB7hi\xCB\xEF1\x0Ao2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/.tmp 2023-11-28 14:55:46,166 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:46,166 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:46,166 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing bacbb02533a4cb91b665cdf46a4cb8bc, disabling compactions & flushes 2023-11-28 14:55:46,166 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 66332b88690d2bc7165356ec660f3d94, disabling compactions & flushes 2023-11-28 14:55:46,167 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:46,167 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:46,167 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:46,167 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:46,167 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. after waiting 0 ms 2023-11-28 14:55:46,167 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. after waiting 0 ms 2023-11-28 14:55:46,167 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:46,167 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:46,167 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:46,167 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:46,167 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:55:46,167 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:55:46,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-28 14:55:46,556 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:46,556 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing e7248b483b8790142454233d994c4e7a, disabling compactions & flushes 2023-11-28 14:55:46,556 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:46,556 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:46,556 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. after waiting 0 ms 2023-11-28 14:55:46,556 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:46,556 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:46,556 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:55:46,559 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-28 14:55:46,560 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701183346559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183346559"}]},"ts":"1701183346559"} 2023-11-28 14:55:46,560 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183346559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183346559"}]},"ts":"1701183346559"} 2023-11-28 14:55:46,560 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183346559"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701183346559"}]},"ts":"1701183346559"} 2023-11-28 14:55:46,574 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-28 14:55:46,574 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-28 14:55:46,574 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183346574"}]},"ts":"1701183346574"} 2023-11-28 14:55:46,575 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-28 14:55:46,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e7248b483b8790142454233d994c4e7a, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=66332b88690d2bc7165356ec660f3d94, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bacbb02533a4cb91b665cdf46a4cb8bc, ASSIGN}] 2023-11-28 14:55:46,582 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e7248b483b8790142454233d994c4e7a, ASSIGN 2023-11-28 14:55:46,582 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bacbb02533a4cb91b665cdf46a4cb8bc, ASSIGN 2023-11-28 14:55:46,582 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=66332b88690d2bc7165356ec660f3d94, ASSIGN 2023-11-28 14:55:46,583 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e7248b483b8790142454233d994c4e7a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:55:46,583 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=66332b88690d2bc7165356ec660f3d94, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:55:46,583 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bacbb02533a4cb91b665cdf46a4cb8bc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41403,1701183201531; forceNewPlan=false, retain=false 2023-11-28 14:55:46,735 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e7248b483b8790142454233d994c4e7a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:46,735 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=bacbb02533a4cb91b665cdf46a4cb8bc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:46,735 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183346734"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183346734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183346734"}]},"ts":"1701183346734"} 2023-11-28 14:55:46,735 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=66332b88690d2bc7165356ec660f3d94, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:46,735 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183346734"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183346734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183346734"}]},"ts":"1701183346734"} 2023-11-28 14:55:46,735 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701183346734"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701183346734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701183346734"}]},"ts":"1701183346734"} 2023-11-28 14:55:46,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure e7248b483b8790142454233d994c4e7a, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:46,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure bacbb02533a4cb91b665cdf46a4cb8bc, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:46,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 66332b88690d2bc7165356ec660f3d94, server=jenkins-hbase4.apache.org,41403,1701183201531}] 2023-11-28 14:55:46,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-28 14:55:46,888 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:46,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:46,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bacbb02533a4cb91b665cdf46a4cb8bc, NAME => 'testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc.', STARTKEY => '2', ENDKEY => ''} 2023-11-28 14:55:46,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:46,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:46,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:46,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:46,914 INFO [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:46,916 DEBUG [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1 2023-11-28 14:55:46,917 DEBUG [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1 2023-11-28 14:55:46,917 INFO [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bacbb02533a4cb91b665cdf46a4cb8bc columnFamilyName family1 2023-11-28 14:55:46,918 INFO [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] regionserver.HStore(310): Store=bacbb02533a4cb91b665cdf46a4cb8bc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:46,918 INFO [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:46,920 DEBUG [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2 2023-11-28 14:55:46,920 DEBUG [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2 2023-11-28 14:55:46,920 INFO [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bacbb02533a4cb91b665cdf46a4cb8bc columnFamilyName family2 2023-11-28 14:55:46,921 INFO [StoreOpener-bacbb02533a4cb91b665cdf46a4cb8bc-1] regionserver.HStore(310): Store=bacbb02533a4cb91b665cdf46a4cb8bc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:46,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:46,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:46,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:55:46,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:55:46,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:55:46,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bacbb02533a4cb91b665cdf46a4cb8bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71303662, jitterRate=0.06250736117362976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:55:46,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:55:46,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc., pid=121, masterSystemTime=1701183346888 2023-11-28 14:55:46,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:46,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:46,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:46,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 66332b88690d2bc7165356ec660f3d94, NAME => 'testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94.', STARTKEY => '1', ENDKEY => '2'} 2023-11-28 14:55:46,929 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=bacbb02533a4cb91b665cdf46a4cb8bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:46,929 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183346929"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183346929"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183346929"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183346929"}]},"ts":"1701183346929"} 2023-11-28 14:55:46,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:46,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:46,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:46,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:46,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=121, resume processing ppid=119 2023-11-28 14:55:46,932 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure bacbb02533a4cb91b665cdf46a4cb8bc, server=jenkins-hbase4.apache.org,41403,1701183201531 in 193 msec 2023-11-28 14:55:46,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bacbb02533a4cb91b665cdf46a4cb8bc, ASSIGN in 353 msec 2023-11-28 14:55:46,951 INFO [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:46,952 DEBUG [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1 2023-11-28 14:55:46,952 DEBUG [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1 2023-11-28 14:55:46,952 INFO [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66332b88690d2bc7165356ec660f3d94 columnFamilyName family1 2023-11-28 14:55:46,953 INFO [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] regionserver.HStore(310): Store=66332b88690d2bc7165356ec660f3d94/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:46,953 INFO [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:46,954 DEBUG [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2 2023-11-28 14:55:46,954 DEBUG [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2 2023-11-28 14:55:46,955 INFO [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66332b88690d2bc7165356ec660f3d94 columnFamilyName family2 2023-11-28 14:55:46,955 INFO [StoreOpener-66332b88690d2bc7165356ec660f3d94-1] regionserver.HStore(310): Store=66332b88690d2bc7165356ec660f3d94/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:46,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:46,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:46,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:55:46,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 66332b88690d2bc7165356ec660f3d94 2023-11-28 14:55:46,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:55:46,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 66332b88690d2bc7165356ec660f3d94; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65021553, jitterRate=-0.031103357672691345}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:55:46,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:55:46,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94., pid=122, masterSystemTime=1701183346888 2023-11-28 14:55:46,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:46,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:46,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:46,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7248b483b8790142454233d994c4e7a, NAME => 'testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a.', STARTKEY => '', ENDKEY => '1'} 2023-11-28 14:55:46,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:46,963 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=66332b88690d2bc7165356ec660f3d94, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:46,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-28 14:55:46,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:46,963 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701183346963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183346963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183346963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183346963"}]},"ts":"1701183346963"} 2023-11-28 14:55:46,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:46,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=122, resume processing ppid=118 2023-11-28 14:55:46,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 66332b88690d2bc7165356ec660f3d94, server=jenkins-hbase4.apache.org,41403,1701183201531 in 228 msec 2023-11-28 14:55:46,967 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=66332b88690d2bc7165356ec660f3d94, ASSIGN in 387 msec 2023-11-28 14:55:46,986 INFO [StoreOpener-e7248b483b8790142454233d994c4e7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:46,987 DEBUG [StoreOpener-e7248b483b8790142454233d994c4e7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1 2023-11-28 14:55:46,987 DEBUG [StoreOpener-e7248b483b8790142454233d994c4e7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1 2023-11-28 14:55:46,987 INFO [StoreOpener-e7248b483b8790142454233d994c4e7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7248b483b8790142454233d994c4e7a columnFamilyName family1 2023-11-28 14:55:46,988 INFO [StoreOpener-e7248b483b8790142454233d994c4e7a-1] regionserver.HStore(310): Store=e7248b483b8790142454233d994c4e7a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:46,988 INFO [StoreOpener-e7248b483b8790142454233d994c4e7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:46,989 DEBUG [StoreOpener-e7248b483b8790142454233d994c4e7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2 2023-11-28 14:55:46,989 DEBUG [StoreOpener-e7248b483b8790142454233d994c4e7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2 2023-11-28 14:55:46,989 INFO [StoreOpener-e7248b483b8790142454233d994c4e7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7248b483b8790142454233d994c4e7a columnFamilyName family2 2023-11-28 14:55:46,990 INFO [StoreOpener-e7248b483b8790142454233d994c4e7a-1] regionserver.HStore(310): Store=e7248b483b8790142454233d994c4e7a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-28 14:55:46,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:46,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:46,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-28 14:55:46,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7248b483b8790142454233d994c4e7a 2023-11-28 14:55:46,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-28 14:55:46,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7248b483b8790142454233d994c4e7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61999941, jitterRate=-0.07612888514995575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-28 14:55:46,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:55:46,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a., pid=120, masterSystemTime=1701183346888 2023-11-28 14:55:46,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:46,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:46,997 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e7248b483b8790142454233d994c4e7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:46,997 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701183346997"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701183346997"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701183346997"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701183346997"}]},"ts":"1701183346997"} 2023-11-28 14:55:46,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=120, resume processing ppid=117 2023-11-28 14:55:46,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure e7248b483b8790142454233d994c4e7a, server=jenkins-hbase4.apache.org,41403,1701183201531 in 262 msec 2023-11-28 14:55:47,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=117, resume processing ppid=116 2023-11-28 14:55:47,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e7248b483b8790142454233d994c4e7a, ASSIGN in 420 msec 2023-11-28 14:55:47,000 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-28 14:55:47,000 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701183347000"}]},"ts":"1701183347000"} 2023-11-28 14:55:47,001 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-28 14:55:47,003 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-28 14:55:47,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2720 sec 2023-11-28 14:55:47,200 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-28 14:55:47,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-28 14:55:47,838 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-28 14:55:47,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:47,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:47,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:47,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:47,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-28 14:55:47,849 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-28 14:55:47,849 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:47,849 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-28 14:55:47,849 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-28 14:55:47,849 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:47,849 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:47,851 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:47,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:47,851 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:47,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:47,851 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:47,851 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:47,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:47,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:47,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:47,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:47,852 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-28 14:55:47,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-28 14:55:47,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-28 14:55:47,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:47,852 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-28 14:55:47,852 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:47,852 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. started... 2023-11-28 14:55:47,852 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:47,853 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. started... 2023-11-28 14:55:47,857 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:47,857 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:47,857 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:47,857 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7248b483b8790142454233d994c4e7a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-28 14:55:47,857 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bacbb02533a4cb91b665cdf46a4cb8bc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-28 14:55:47,857 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. started... 2023-11-28 14:55:47,858 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 66332b88690d2bc7165356ec660f3d94 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-28 14:55:47,921 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128fa97f4354def4687ad3108a750e7cacc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231128fa97f4354def4687ad3108a750e7cacc 2023-11-28 14:55:47,926 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112844bef5d63ee54d859351d287ddafacb4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112844bef5d63ee54d859351d287ddafacb4 2023-11-28 14:55:48,312 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128e738f0eaced346c0b30d2951bbca9fe7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128e738f0eaced346c0b30d2951bbca9fe7 2023-11-28 14:55:48,340 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/bbe418e82b0c42c5a530426e1417e5c7 2023-11-28 14:55:48,344 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/d81593550b47413d8242f0866fbe91c4 2023-11-28 14:55:48,385 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128fc7ca978bef343a5a682da8e375af62d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231128fc7ca978bef343a5a682da8e375af62d 2023-11-28 14:55:48,387 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311280c668fc067a64c98a1bb66ff7cebeb5f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311280c668fc067a64c98a1bb66ff7cebeb5f 2023-11-28 14:55:48,393 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/a6370398fc984b60899ee31b1d92fd68 2023-11-28 14:55:48,397 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/d81593550b47413d8242f0866fbe91c4 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/d81593550b47413d8242f0866fbe91c4 2023-11-28 14:55:48,420 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/d81593550b47413d8242f0866fbe91c4, entries=4, sequenceid=5, filesize=5.5 K 2023-11-28 14:55:48,421 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/a6370398fc984b60899ee31b1d92fd68 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a6370398fc984b60899ee31b1d92fd68 2023-11-28 14:55:48,429 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a6370398fc984b60899ee31b1d92fd68, entries=2, sequenceid=5, filesize=5.1 K 2023-11-28 14:55:48,429 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e7248b483b8790142454233d994c4e7a in 572ms, sequenceid=5, compaction requested=false 2023-11-28 14:55:48,430 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:55:48,430 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:48,430 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:48,727 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/7e13f46d17a8415a8bdf4c676c22ad6a 2023-11-28 14:55:48,789 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/1520c63239b44e8f9520d9eaca4c2ca0 2023-11-28 14:55:48,792 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/bbe418e82b0c42c5a530426e1417e5c7 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/bbe418e82b0c42c5a530426e1417e5c7 2023-11-28 14:55:48,817 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/bbe418e82b0c42c5a530426e1417e5c7, entries=4, sequenceid=5, filesize=5.5 K 2023-11-28 14:55:48,817 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/1520c63239b44e8f9520d9eaca4c2ca0 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/1520c63239b44e8f9520d9eaca4c2ca0 2023-11-28 14:55:48,821 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/1520c63239b44e8f9520d9eaca4c2ca0, entries=2, sequenceid=5, filesize=5.1 K 2023-11-28 14:55:48,822 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 66332b88690d2bc7165356ec660f3d94 in 964ms, sequenceid=5, compaction requested=false 2023-11-28 14:55:48,822 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:55:48,822 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:48,822 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:49,161 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128098fe65ec53742d78e25a79080edc16b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231128098fe65ec53742d78e25a79080edc16b 2023-11-28 14:55:49,169 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/750f8600348b470eb1cc78e3ce326051 2023-11-28 14:55:49,173 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/7e13f46d17a8415a8bdf4c676c22ad6a as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7e13f46d17a8415a8bdf4c676c22ad6a 2023-11-28 14:55:49,196 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7e13f46d17a8415a8bdf4c676c22ad6a, entries=4, sequenceid=5, filesize=5.5 K 2023-11-28 14:55:49,197 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/750f8600348b470eb1cc78e3ce326051 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/750f8600348b470eb1cc78e3ce326051 2023-11-28 14:55:49,199 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/750f8600348b470eb1cc78e3ce326051, entries=2, sequenceid=5, filesize=5.1 K 2023-11-28 14:55:49,200 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bacbb02533a4cb91b665cdf46a4cb8bc in 1343ms, sequenceid=5, compaction requested=false 2023-11-28 14:55:49,200 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:55:49,200 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-28 14:55:49,200 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-28 14:55:49,204 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,204 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:49,204 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:49,204 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:49,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-28 14:55:49,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67381594[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:49,205 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-28 14:55:49,206 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:49,207 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:49,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:49,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:49,207 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-28 14:55:49,207 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,207 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:49,207 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-28 14:55:49,207 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:49,208 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-28 14:55:49,208 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:49,208 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,208 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-28 14:55:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:49,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-28 14:55:49,210 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-28 14:55:49,211 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:49,211 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:49,211 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-28 14:55:49,211 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:49,216 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:49,216 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:49,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:49,216 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:49,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:49,217 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:49,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:49,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,218 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:49,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:49,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,220 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,220 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:49,220 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:49,220 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:49,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:49,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-28 14:55:49,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:49,220 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:49,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-28 14:55:49,220 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,220 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:49,221 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:49,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:49,221 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:49,221 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:49,221 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:49,221 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:49,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:49,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:49,321 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:49,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:49,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:49,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:49,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:49,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:49,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:49,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-28 14:55:49,328 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-28 14:55:49,328 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:49,329 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-28 14:55:49,329 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-28 14:55:49,329 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:49,329 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:49,331 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,331 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:49,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:49,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:49,331 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:49,331 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:49,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:49,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:49,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:49,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:49,332 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-28 14:55:49,332 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-28 14:55:49,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-28 14:55:49,333 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-28 14:55:49,333 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:49,333 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-28 14:55:49,337 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:49,337 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. started... 2023-11-28 14:55:49,337 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:49,337 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:49,337 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:49,337 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. started... 2023-11-28 14:55:49,338 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 66332b88690d2bc7165356ec660f3d94 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-28 14:55:49,337 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:49,337 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7248b483b8790142454233d994c4e7a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-28 14:55:49,338 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. started... 2023-11-28 14:55:49,338 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bacbb02533a4cb91b665cdf46a4cb8bc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-28 14:55:49,793 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311280e034cf3295f48b2a7532d6a45063277 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311280e034cf3295f48b2a7532d6a45063277 2023-11-28 14:55:49,801 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128357f73fdab6a473b9cf59e4d16f764ca to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128357f73fdab6a473b9cf59e4d16f764ca 2023-11-28 14:55:49,801 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311280ca4dbf347f3406aba788240bd1e7549 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311280ca4dbf347f3406aba788240bd1e7549 2023-11-28 14:55:49,821 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/7c0db40b1a3242c8bc7d10745e9aeb0b 2023-11-28 14:55:49,822 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/c4a2a2e7c08540c29bc662b5b9a96e79 2023-11-28 14:55:49,855 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128545c72366aab42c59afaea9021148b9d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231128545c72366aab42c59afaea9021148b9d 2023-11-28 14:55:49,861 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/5f5de8a85c844e338f697cab9939f83d 2023-11-28 14:55:49,864 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/7c0db40b1a3242c8bc7d10745e9aeb0b as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/7c0db40b1a3242c8bc7d10745e9aeb0b 2023-11-28 14:55:49,887 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/7c0db40b1a3242c8bc7d10745e9aeb0b, entries=4, sequenceid=9, filesize=5.5 K 2023-11-28 14:55:49,887 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/5f5de8a85c844e338f697cab9939f83d as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/5f5de8a85c844e338f697cab9939f83d 2023-11-28 14:55:49,890 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/5f5de8a85c844e338f697cab9939f83d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-28 14:55:49,890 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e7248b483b8790142454233d994c4e7a in 553ms, sequenceid=9, compaction requested=false 2023-11-28 14:55:49,891 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:55:49,891 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:49,891 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:50,216 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/9cc0ea6122d64501bd1ff346b907a796 2023-11-28 14:55:50,265 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311284dc4a8a4e02d490fae76edbcfa226b89 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311284dc4a8a4e02d490fae76edbcfa226b89 2023-11-28 14:55:50,269 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/bc0c42d914a24ed09df637eac0fbe3f5 2023-11-28 14:55:50,273 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/c4a2a2e7c08540c29bc662b5b9a96e79 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/c4a2a2e7c08540c29bc662b5b9a96e79 2023-11-28 14:55:50,297 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/c4a2a2e7c08540c29bc662b5b9a96e79, entries=4, sequenceid=9, filesize=5.5 K 2023-11-28 14:55:50,297 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/bc0c42d914a24ed09df637eac0fbe3f5 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/bc0c42d914a24ed09df637eac0fbe3f5 2023-11-28 14:55:50,301 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/bc0c42d914a24ed09df637eac0fbe3f5, entries=2, sequenceid=9, filesize=5.1 K 2023-11-28 14:55:50,302 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 66332b88690d2bc7165356ec660f3d94 in 964ms, sequenceid=9, compaction requested=false 2023-11-28 14:55:50,302 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:55:50,302 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:50,302 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:50,650 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311289a52d4473b724646bae0c39bf9e2f47b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311289a52d4473b724646bae0c39bf9e2f47b 2023-11-28 14:55:51,055 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/6a9e8bc843a2436caffa10a3279a47d4 2023-11-28 14:55:51,059 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/9cc0ea6122d64501bd1ff346b907a796 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/9cc0ea6122d64501bd1ff346b907a796 2023-11-28 14:55:51,091 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/9cc0ea6122d64501bd1ff346b907a796, entries=4, sequenceid=9, filesize=5.5 K 2023-11-28 14:55:51,092 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/6a9e8bc843a2436caffa10a3279a47d4 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/6a9e8bc843a2436caffa10a3279a47d4 2023-11-28 14:55:51,095 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/6a9e8bc843a2436caffa10a3279a47d4, entries=2, sequenceid=9, filesize=5.1 K 2023-11-28 14:55:51,096 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bacbb02533a4cb91b665cdf46a4cb8bc in 1758ms, sequenceid=9, compaction requested=false 2023-11-28 14:55:51,096 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:55:51,096 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:51,096 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:51,096 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:51,096 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,096 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-28 14:55:51,096 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-28 14:55:51,098 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,098 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:51,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:51,099 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:51,099 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:51,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:51,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-28 14:55:51,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e8c027[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:51,100 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-28 14:55:51,100 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:51,101 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:51,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:51,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:51,102 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-28 14:55:51,102 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-28 14:55:51,102 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:51,102 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,102 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:51,103 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,103 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-28 14:55:51,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:51,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:51,103 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:51,103 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-28 14:55:51,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:51,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:51,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:51,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:51,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-28 14:55:51,106 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-28 14:55:51,106 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:51,106 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:51,106 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-28 14:55:51,106 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:51,113 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:51,113 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:51,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:51,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:51,113 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:51,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:51,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:51,114 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:51,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:51,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:51,115 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,117 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:51,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:51,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-28 14:55:51,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:51,118 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:51,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:51,118 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:51,218 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:51,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:51,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:51,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:51,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:51,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:51,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:51,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-28 14:55:51,224 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-28 14:55:51,224 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:51,224 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-28 14:55:51,224 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-28 14:55:51,225 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:51,225 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:51,226 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:51,226 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:51,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:51,227 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:51,227 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:51,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:51,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:51,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:51,228 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-28 14:55:51,228 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-28 14:55:51,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-28 14:55:51,228 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-28 14:55:51,228 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:51,228 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-28 14:55:51,229 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:51,229 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:51,229 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. started... 2023-11-28 14:55:51,229 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. started... 2023-11-28 14:55:51,229 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7248b483b8790142454233d994c4e7a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-28 14:55:51,229 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bacbb02533a4cb91b665cdf46a4cb8bc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-28 14:55:51,232 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:51,232 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:51,232 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:51,232 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. started... 2023-11-28 14:55:51,232 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 66332b88690d2bc7165356ec660f3d94 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-28 14:55:51,290 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311281503beaa8c104f8f88f74366dc6bdb31 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311281503beaa8c104f8f88f74366dc6bdb31 2023-11-28 14:55:51,693 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311288cd72de9bda649028260f9e85673baa5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311288cd72de9bda649028260f9e85673baa5 2023-11-28 14:55:51,701 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112867dd24ee4ef744dfba507efc4a9312ee to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112867dd24ee4ef744dfba507efc4a9312ee 2023-11-28 14:55:51,713 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/730f590677f64e4d802be7dab59ae0f1 2023-11-28 14:55:51,715 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/0f1a77b1490944a68eb714c753bc54cb 2023-11-28 14:55:51,756 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128b7e0ac391a114447825474eb4a022a3f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231128b7e0ac391a114447825474eb4a022a3f 2023-11-28 14:55:52,122 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/df1c43efc83d4673a2f1f7b3e55ed0f3 2023-11-28 14:55:52,156 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311284c5f252088f54869a81a0a4f8e799d05 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311284c5f252088f54869a81a0a4f8e799d05 2023-11-28 14:55:52,160 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/89cd1b1088bb4e7889162c72b2838a73 2023-11-28 14:55:52,162 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/a09e20527ec64df8aa34697be893952f 2023-11-28 14:55:52,165 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/730f590677f64e4d802be7dab59ae0f1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/730f590677f64e4d802be7dab59ae0f1 2023-11-28 14:55:52,166 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/0f1a77b1490944a68eb714c753bc54cb as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/0f1a77b1490944a68eb714c753bc54cb 2023-11-28 14:55:52,194 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/730f590677f64e4d802be7dab59ae0f1, entries=4, sequenceid=13, filesize=5.5 K 2023-11-28 14:55:52,195 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/89cd1b1088bb4e7889162c72b2838a73 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/89cd1b1088bb4e7889162c72b2838a73 2023-11-28 14:55:52,198 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/89cd1b1088bb4e7889162c72b2838a73, entries=2, sequenceid=13, filesize=5.1 K 2023-11-28 14:55:52,199 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bacbb02533a4cb91b665cdf46a4cb8bc in 970ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:52,199 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:55:52,199 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:52,199 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:52,208 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/0f1a77b1490944a68eb714c753bc54cb, entries=4, sequenceid=13, filesize=5.5 K 2023-11-28 14:55:52,209 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/a09e20527ec64df8aa34697be893952f as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a09e20527ec64df8aa34697be893952f 2023-11-28 14:55:52,218 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a09e20527ec64df8aa34697be893952f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-28 14:55:52,218 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e7248b483b8790142454233d994c4e7a in 989ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:52,218 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:55:52,218 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:52,219 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:52,392 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-28 14:55:52,554 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112890d238dcd5c94dc9b772859664646150 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112890d238dcd5c94dc9b772859664646150 2023-11-28 14:55:52,959 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/f90ddb61ef7c4f14b3cdaf0f179f5a2a 2023-11-28 14:55:52,972 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/df1c43efc83d4673a2f1f7b3e55ed0f3 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/df1c43efc83d4673a2f1f7b3e55ed0f3 2023-11-28 14:55:53,005 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/df1c43efc83d4673a2f1f7b3e55ed0f3, entries=4, sequenceid=13, filesize=5.5 K 2023-11-28 14:55:53,006 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/f90ddb61ef7c4f14b3cdaf0f179f5a2a as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/f90ddb61ef7c4f14b3cdaf0f179f5a2a 2023-11-28 14:55:53,012 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/f90ddb61ef7c4f14b3cdaf0f179f5a2a, entries=2, sequenceid=13, filesize=5.1 K 2023-11-28 14:55:53,013 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 66332b88690d2bc7165356ec660f3d94 in 1781ms, sequenceid=13, compaction requested=true 2023-11-28 14:55:53,013 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:55:53,013 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:53,013 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:53,013 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:53,013 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,013 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-28 14:55:53,014 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-28 14:55:53,015 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,015 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:53,015 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:53,016 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:53,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-28 14:55:53,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6848f632[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:53,017 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-28 14:55:53,017 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:53,019 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:53,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:53,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:53,019 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-28 14:55:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-28 14:55:53,020 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:53,020 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,020 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-28 14:55:53,021 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:53,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-28 14:55:53,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:53,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:53,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-28 14:55:53,024 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-28 14:55:53,024 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:53,024 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:53,024 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-28 14:55:53,024 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:53,026 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:53,026 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:53,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:53,026 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:53,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:53,028 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,029 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:53,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:53,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,032 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,032 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:53,032 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:53,032 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:53,032 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:53,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:53,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-28 14:55:53,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:53,032 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,032 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:53,032 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:53,032 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:53,033 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:53,033 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:53,033 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:53,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:53,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:53,133 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:53,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:53,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:53,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:53,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-28 14:55:53,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:53,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:53,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-28 14:55:53,148 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-28 14:55:53,148 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:53,148 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-28 14:55:53,148 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-28 14:55:53,149 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:53,149 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:53,151 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:53,151 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:53,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:53,151 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:53,151 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:53,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:53,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:53,152 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-28 14:55:53,153 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-28 14:55:53,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-28 14:55:53,153 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-28 14:55:53,153 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:53,153 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-28 14:55:53,155 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:53,155 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. started... 2023-11-28 14:55:53,155 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:53,156 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. started... 2023-11-28 14:55:53,156 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7248b483b8790142454233d994c4e7a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-28 14:55:53,156 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bacbb02533a4cb91b665cdf46a4cb8bc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-28 14:55:53,156 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:53,156 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:53,156 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:53,156 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. started... 2023-11-28 14:55:53,156 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 66332b88690d2bc7165356ec660f3d94 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-28 14:55:53,195 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:55:53,195 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ad15e6c to 127.0.0.1:62725 2023-11-28 14:55:53,195 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:55:53,195 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:55:53,195 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50dbf78e to 127.0.0.1:62725 2023-11-28 14:55:53,195 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:55:53,244 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128524d829178384256a093a387ec19ed29 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128524d829178384256a093a387ec19ed29 2023-11-28 14:55:53,623 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128bb0274a62cbb41ddb0676b552b5eadf0 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128bb0274a62cbb41ddb0676b552b5eadf0 2023-11-28 14:55:53,639 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311288eecf2de8c604fb485d6b1bec3a5ea51 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311288eecf2de8c604fb485d6b1bec3a5ea51 2023-11-28 14:55:53,660 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/8d5c5cafcc1d40d581d7469d3e2b8391 2023-11-28 14:55:54,037 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/2f04b08fabfe496f8a1d8266e4438764 2023-11-28 14:55:54,053 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/844326ad9d024b27986ad0e951229977 2023-11-28 14:55:54,070 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128abf9f1a814404de0bdd48faa5262d93b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231128abf9f1a814404de0bdd48faa5262d93b 2023-11-28 14:55:54,090 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128728a70213a5744768c9e5371d5fd0b8f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231128728a70213a5744768c9e5371d5fd0b8f 2023-11-28 14:55:54,093 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/f9cb7b90b9b342d880cc6b8929a40080 2023-11-28 14:55:54,096 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/8d5c5cafcc1d40d581d7469d3e2b8391 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/8d5c5cafcc1d40d581d7469d3e2b8391 2023-11-28 14:55:54,123 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/8d5c5cafcc1d40d581d7469d3e2b8391, entries=4, sequenceid=17, filesize=5.5 K 2023-11-28 14:55:54,124 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/f9cb7b90b9b342d880cc6b8929a40080 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/f9cb7b90b9b342d880cc6b8929a40080 2023-11-28 14:55:54,127 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/f9cb7b90b9b342d880cc6b8929a40080, entries=2, sequenceid=17, filesize=5.1 K 2023-11-28 14:55:54,128 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bacbb02533a4cb91b665cdf46a4cb8bc in 972ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:54,128 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:55:54,128 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:54,128 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:54,474 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/d03126b4345e4fbaba5a791b100faa02 2023-11-28 14:55:54,478 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/2f04b08fabfe496f8a1d8266e4438764 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/2f04b08fabfe496f8a1d8266e4438764 2023-11-28 14:55:54,484 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112850656d2f92d34661b38375cddf2ee928 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112850656d2f92d34661b38375cddf2ee928 2023-11-28 14:55:54,502 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/2f04b08fabfe496f8a1d8266e4438764, entries=4, sequenceid=17, filesize=5.5 K 2023-11-28 14:55:54,503 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/d03126b4345e4fbaba5a791b100faa02 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/d03126b4345e4fbaba5a791b100faa02 2023-11-28 14:55:54,505 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/d03126b4345e4fbaba5a791b100faa02, entries=2, sequenceid=17, filesize=5.1 K 2023-11-28 14:55:54,506 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e7248b483b8790142454233d994c4e7a in 1350ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:54,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:55:54,506 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:54,506 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:54,889 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/091ceb9cc0a74a4a92bb2418f0ff272f 2023-11-28 14:55:54,893 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/844326ad9d024b27986ad0e951229977 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/844326ad9d024b27986ad0e951229977 2023-11-28 14:55:54,926 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/844326ad9d024b27986ad0e951229977, entries=4, sequenceid=17, filesize=5.5 K 2023-11-28 14:55:54,927 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/091ceb9cc0a74a4a92bb2418f0ff272f as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/091ceb9cc0a74a4a92bb2418f0ff272f 2023-11-28 14:55:54,930 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/091ceb9cc0a74a4a92bb2418f0ff272f, entries=2, sequenceid=17, filesize=5.1 K 2023-11-28 14:55:54,931 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 66332b88690d2bc7165356ec660f3d94 in 1775ms, sequenceid=17, compaction requested=true 2023-11-28 14:55:54,931 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:55:54,931 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:54,931 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:54,931 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:54,931 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,931 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-28 14:55:54,931 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-28 14:55:54,934 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,934 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:54,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:54,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:54,935 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:54,935 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:54,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:54,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-28 14:55:54,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a0c33dd[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:54,936 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-28 14:55:54,936 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:54,945 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:54,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:54,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-28 14:55:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-28 14:55:54,945 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:54,945 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,945 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:54,946 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-28 14:55:54,946 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,946 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:54,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:54,946 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-28 14:55:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:54,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-28 14:55:54,949 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-28 14:55:54,949 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:54,949 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:54,949 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-28 14:55:54,949 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:54,951 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:54,951 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:54,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:54,951 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:54,952 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,953 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,955 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,955 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:54,955 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:54,955 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:54,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-28 14:55:54,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:54,955 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:54,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:54,955 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:54,955 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:54,955 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:54,956 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:54,956 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:54,956 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:54,956 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:54,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:55,056 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:55,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:55,064 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:55,070 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:55,077 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:55:55,078 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:55:55,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-28 14:55:55,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-28 14:55:55,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-28 14:55:55,174 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-28 14:55:55,174 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:55,174 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-28 14:55:55,174 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-28 14:55:55,174 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:55,174 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:55,176 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:55,176 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:55,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:55,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:55,176 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:55,176 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-28 14:55:55,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:55,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-28 14:55:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:55,177 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-28 14:55:55,177 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-28 14:55:55,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-28 14:55:55,177 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-28 14:55:55,177 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-28 14:55:55,177 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-28 14:55:55,178 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:55,178 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. started... 2023-11-28 14:55:55,178 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing e7248b483b8790142454233d994c4e7a 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-28 14:55:55,178 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:55,179 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. started... 2023-11-28 14:55:55,178 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-28 14:55:55,179 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing bacbb02533a4cb91b665cdf46a4cb8bc 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-28 14:55:55,179 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-28 14:55:55,179 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:55,179 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. started... 2023-11-28 14:55:55,179 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 66332b88690d2bc7165356ec660f3d94 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-28 14:55:55,223 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/1a5bd8c6527642668458872c28e560af 2023-11-28 14:55:55,229 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/468d284681804724a692ccd1e06c430f 2023-11-28 14:55:55,254 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a5bd8c6527642668458872c28e560af 2023-11-28 14:55:55,260 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 468d284681804724a692ccd1e06c430f 2023-11-28 14:55:55,672 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/8f15bf360a6849d98583925a67c059c8 2023-11-28 14:55:55,676 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f15bf360a6849d98583925a67c059c8 2023-11-28 14:55:55,677 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/468d284681804724a692ccd1e06c430f as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/468d284681804724a692ccd1e06c430f 2023-11-28 14:55:55,703 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 468d284681804724a692ccd1e06c430f 2023-11-28 14:55:55,703 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/468d284681804724a692ccd1e06c430f, entries=3, sequenceid=23, filesize=5.2 K 2023-11-28 14:55:55,704 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/8f15bf360a6849d98583925a67c059c8 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/8f15bf360a6849d98583925a67c059c8 2023-11-28 14:55:55,707 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f15bf360a6849d98583925a67c059c8 2023-11-28 14:55:55,707 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/8f15bf360a6849d98583925a67c059c8, entries=1, sequenceid=23, filesize=5.0 K 2023-11-28 14:55:55,707 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e7248b483b8790142454233d994c4e7a in 529ms, sequenceid=23, compaction requested=true 2023-11-28 14:55:55,707 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:55:55,708 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:55,708 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-28 14:55:56,021 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/1655ad35c86f4c939ba66dbb53f1f871 2023-11-28 14:55:56,045 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1655ad35c86f4c939ba66dbb53f1f871 2023-11-28 14:55:56,070 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/12c7dd9868174dcab4434f0d4d8f087b 2023-11-28 14:55:56,073 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12c7dd9868174dcab4434f0d4d8f087b 2023-11-28 14:55:56,073 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/1a5bd8c6527642668458872c28e560af as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/1a5bd8c6527642668458872c28e560af 2023-11-28 14:55:56,098 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a5bd8c6527642668458872c28e560af 2023-11-28 14:55:56,098 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/1a5bd8c6527642668458872c28e560af, entries=3, sequenceid=23, filesize=5.2 K 2023-11-28 14:55:56,099 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/12c7dd9868174dcab4434f0d4d8f087b as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/12c7dd9868174dcab4434f0d4d8f087b 2023-11-28 14:55:56,105 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12c7dd9868174dcab4434f0d4d8f087b 2023-11-28 14:55:56,105 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/12c7dd9868174dcab4434f0d4d8f087b, entries=1, sequenceid=23, filesize=5.0 K 2023-11-28 14:55:56,106 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 66332b88690d2bc7165356ec660f3d94 in 927ms, sequenceid=23, compaction requested=true 2023-11-28 14:55:56,106 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:55:56,106 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:55:56,106 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-28 14:55:56,860 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/03403649917b4b43be14db9e71af96d6 2023-11-28 14:55:56,864 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03403649917b4b43be14db9e71af96d6 2023-11-28 14:55:56,864 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/1655ad35c86f4c939ba66dbb53f1f871 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/1655ad35c86f4c939ba66dbb53f1f871 2023-11-28 14:55:56,887 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1655ad35c86f4c939ba66dbb53f1f871 2023-11-28 14:55:56,887 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/1655ad35c86f4c939ba66dbb53f1f871, entries=3, sequenceid=23, filesize=5.2 K 2023-11-28 14:55:56,888 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/03403649917b4b43be14db9e71af96d6 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/03403649917b4b43be14db9e71af96d6 2023-11-28 14:55:56,891 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03403649917b4b43be14db9e71af96d6 2023-11-28 14:55:56,891 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/03403649917b4b43be14db9e71af96d6, entries=1, sequenceid=23, filesize=5.0 K 2023-11-28 14:55:56,892 INFO [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bacbb02533a4cb91b665cdf46a4cb8bc in 1713ms, sequenceid=23, compaction requested=true 2023-11-28 14:55:56,892 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:55:56,892 DEBUG [rs(jenkins-hbase4.apache.org,41403,1701183201531)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:56,892 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-28 14:55:56,892 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-28 14:55:56,892 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,892 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-28 14:55:56,892 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-28 14:55:56,893 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,893 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:56,894 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-28 14:55:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:56,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:56,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:56,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41403,1701183201531' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-28 14:55:56,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2dbf03bd[Count = 0] remaining members to acquire global barrier 2023-11-28 14:55:56,895 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-28 14:55:56,895 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:56,896 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:56,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:56,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:56,897 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-28 14:55:56,897 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-28 14:55:56,897 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41403,1701183201531' in zk 2023-11-28 14:55:56,897 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,897 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-28 14:55:56,899 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-28 14:55:56,899 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:56,899 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,899 DEBUG [member: 'jenkins-hbase4.apache.org,41403,1701183201531' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-28 14:55:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:56,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:56,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:56,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:56,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41403,1701183201531': 2023-11-28 14:55:56,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41403,1701183201531' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-28 14:55:56,902 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-28 14:55:56,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-28 14:55:56,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-28 14:55:56,902 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-28 14:55:56,902 INFO [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-28 14:55:56,908 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:56,909 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:56,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:56,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:56,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:56,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-28 14:55:56,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-28 14:55:56,909 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:56,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:56,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:56,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-28 14:55:56,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:56,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:56,911 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-28 14:55:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,913 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-28 14:55:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-28 14:55:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,918 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,918 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-28 14:55:56,918 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:56,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-28 14:55:56,918 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-28 14:55:56,918 DEBUG [(jenkins-hbase4.apache.org,35905,1701183200327)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-28 14:55:56,918 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-28 14:55:56,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-28 14:55:56,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-28 14:55:56,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-28 14:55:56,918 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:55:56,918 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:56,918 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-28 14:55:56,919 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-28 14:55:56,918 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-28 14:55:56,919 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-28 14:55:56,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-28 14:55:56,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-28 14:55:57,019 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-28 14:55:57,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35905] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-28 14:55:57,021 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:57,021 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): e7248b483b8790142454233d994c4e7a/family1 is initiating major compaction (all files) 2023-11-28 14:55:57,021 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:57,021 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:57,022 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of e7248b483b8790142454233d994c4e7a/family1 in testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:57,022 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/d81593550b47413d8242f0866fbe91c4, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/7c0db40b1a3242c8bc7d10745e9aeb0b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/0f1a77b1490944a68eb714c753bc54cb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/2f04b08fabfe496f8a1d8266e4438764, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/468d284681804724a692ccd1e06c430f] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp, totalSize=27.1 K 2023-11-28 14:55:57,022 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting d81593550b47413d8242f0866fbe91c4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183347845 2023-11-28 14:55:57,023 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 7c0db40b1a3242c8bc7d10745e9aeb0b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183349323 2023-11-28 14:55:57,023 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 0f1a77b1490944a68eb714c753bc54cb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183351220 2023-11-28 14:55:57,024 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 2f04b08fabfe496f8a1d8266e4438764, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183353135 2023-11-28 14:55:57,024 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 468d284681804724a692ccd1e06c430f, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:55:57,049 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): e7248b483b8790142454233d994c4e7a#family1#compaction#196 average throughput is 0.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:57,108 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231128101ece87edee418d8d7c72e5b7c9d3dd_del 2023-11-28 14:55:57,108 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128101ece87edee418d8d7c72e5b7c9d3dd_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128101ece87edee418d8d7c72e5b7c9d3dd_del 2023-11-28 14:55:57,965 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43c79cc8abea40f1bc73183b524bf0c2 2023-11-28 14:55:57,966 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family1/43c79cc8abea40f1bc73183b524bf0c2 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/43c79cc8abea40f1bc73183b524bf0c2 2023-11-28 14:55:57,988 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43c79cc8abea40f1bc73183b524bf0c2 2023-11-28 14:55:57,988 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e7248b483b8790142454233d994c4e7a/family1 of e7248b483b8790142454233d994c4e7a into 43c79cc8abea40f1bc73183b524bf0c2(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:55:57,989 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:55:57,989 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:57,989 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): e7248b483b8790142454233d994c4e7a/family2 is initiating major compaction (all files) 2023-11-28 14:55:57,989 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:57,989 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:57,989 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of e7248b483b8790142454233d994c4e7a/family2 in testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:55:57,989 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a6370398fc984b60899ee31b1d92fd68, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/5f5de8a85c844e338f697cab9939f83d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a09e20527ec64df8aa34697be893952f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/d03126b4345e4fbaba5a791b100faa02, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/8f15bf360a6849d98583925a67c059c8] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp, totalSize=25.4 K 2023-11-28 14:55:57,989 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting a6370398fc984b60899ee31b1d92fd68, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183347845 2023-11-28 14:55:57,990 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 5f5de8a85c844e338f697cab9939f83d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183349323 2023-11-28 14:55:57,990 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting a09e20527ec64df8aa34697be893952f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183351220 2023-11-28 14:55:57,990 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting d03126b4345e4fbaba5a791b100faa02, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183353135 2023-11-28 14:55:57,991 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 8f15bf360a6849d98583925a67c059c8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:55:57,998 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): e7248b483b8790142454233d994c4e7a#family2#compaction#197 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:58,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/d81593550b47413d8242f0866fbe91c4, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/7c0db40b1a3242c8bc7d10745e9aeb0b, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/0f1a77b1490944a68eb714c753bc54cb, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/2f04b08fabfe496f8a1d8266e4438764, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/468d284681804724a692ccd1e06c430f] to archive 2023-11-28 14:55:58,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:58,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/d81593550b47413d8242f0866fbe91c4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/d81593550b47413d8242f0866fbe91c4 2023-11-28 14:55:58,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/7c0db40b1a3242c8bc7d10745e9aeb0b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/7c0db40b1a3242c8bc7d10745e9aeb0b 2023-11-28 14:55:58,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/0f1a77b1490944a68eb714c753bc54cb to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/0f1a77b1490944a68eb714c753bc54cb 2023-11-28 14:55:58,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/2f04b08fabfe496f8a1d8266e4438764 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/2f04b08fabfe496f8a1d8266e4438764 2023-11-28 14:55:58,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/468d284681804724a692ccd1e06c430f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/468d284681804724a692ccd1e06c430f 2023-11-28 14:55:58,405 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311288914ed0458cf4cab8614e53f6d6f55cf_del 2023-11-28 14:55:58,405 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311288914ed0458cf4cab8614e53f6d6f55cf_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311288914ed0458cf4cab8614e53f6d6f55cf_del 2023-11-28 14:55:59,217 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35107520fdad476fb5ac657502a57120 2023-11-28 14:55:59,217 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/.tmp/family2/35107520fdad476fb5ac657502a57120 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/35107520fdad476fb5ac657502a57120 2023-11-28 14:55:59,220 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35107520fdad476fb5ac657502a57120 2023-11-28 14:55:59,221 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e7248b483b8790142454233d994c4e7a/family2 of e7248b483b8790142454233d994c4e7a into 35107520fdad476fb5ac657502a57120(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:55:59,221 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:55:59,221 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:55:59,221 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): bacbb02533a4cb91b665cdf46a4cb8bc/family1 is initiating major compaction (all files) 2023-11-28 14:55:59,221 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:55:59,222 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:55:59,223 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of bacbb02533a4cb91b665cdf46a4cb8bc/family1 in testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:55:59,223 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7e13f46d17a8415a8bdf4c676c22ad6a, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/9cc0ea6122d64501bd1ff346b907a796, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/730f590677f64e4d802be7dab59ae0f1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/8d5c5cafcc1d40d581d7469d3e2b8391, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/1655ad35c86f4c939ba66dbb53f1f871] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp, totalSize=27.1 K 2023-11-28 14:55:59,223 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 7e13f46d17a8415a8bdf4c676c22ad6a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183347845 2023-11-28 14:55:59,224 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 9cc0ea6122d64501bd1ff346b907a796, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183349324 2023-11-28 14:55:59,224 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 730f590677f64e4d802be7dab59ae0f1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183351220 2023-11-28 14:55:59,224 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 8d5c5cafcc1d40d581d7469d3e2b8391, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183353136 2023-11-28 14:55:59,225 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 1655ad35c86f4c939ba66dbb53f1f871, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:55:59,231 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): bacbb02533a4cb91b665cdf46a4cb8bc#family1#compaction#198 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:55:59,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a6370398fc984b60899ee31b1d92fd68, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/5f5de8a85c844e338f697cab9939f83d, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a09e20527ec64df8aa34697be893952f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/d03126b4345e4fbaba5a791b100faa02, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/8f15bf360a6849d98583925a67c059c8] to archive 2023-11-28 14:55:59,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:55:59,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a6370398fc984b60899ee31b1d92fd68 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a6370398fc984b60899ee31b1d92fd68 2023-11-28 14:55:59,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/5f5de8a85c844e338f697cab9939f83d to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/5f5de8a85c844e338f697cab9939f83d 2023-11-28 14:55:59,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a09e20527ec64df8aa34697be893952f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/a09e20527ec64df8aa34697be893952f 2023-11-28 14:55:59,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/d03126b4345e4fbaba5a791b100faa02 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/d03126b4345e4fbaba5a791b100faa02 2023-11-28 14:55:59,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/8f15bf360a6849d98583925a67c059c8 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family2/8f15bf360a6849d98583925a67c059c8 2023-11-28 14:55:59,675 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231128b9c8b5b0266b4179b2fd16066027145b_del 2023-11-28 14:55:59,675 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128b9c8b5b0266b4179b2fd16066027145b_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128b9c8b5b0266b4179b2fd16066027145b_del 2023-11-28 14:56:00,528 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4fb7e4c32ed4baba75a4a3dcbcbef4c 2023-11-28 14:56:00,529 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family1/f4fb7e4c32ed4baba75a4a3dcbcbef4c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/f4fb7e4c32ed4baba75a4a3dcbcbef4c 2023-11-28 14:56:00,549 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4fb7e4c32ed4baba75a4a3dcbcbef4c 2023-11-28 14:56:00,550 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bacbb02533a4cb91b665cdf46a4cb8bc/family1 of bacbb02533a4cb91b665cdf46a4cb8bc into f4fb7e4c32ed4baba75a4a3dcbcbef4c(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-28 14:56:00,550 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:56:00,550 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:56:00,550 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): bacbb02533a4cb91b665cdf46a4cb8bc/family2 is initiating major compaction (all files) 2023-11-28 14:56:00,550 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:56:00,550 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:56:00,551 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of bacbb02533a4cb91b665cdf46a4cb8bc/family2 in testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:56:00,551 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/750f8600348b470eb1cc78e3ce326051, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/6a9e8bc843a2436caffa10a3279a47d4, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/89cd1b1088bb4e7889162c72b2838a73, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/f9cb7b90b9b342d880cc6b8929a40080, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/03403649917b4b43be14db9e71af96d6] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp, totalSize=25.4 K 2023-11-28 14:56:00,551 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 750f8600348b470eb1cc78e3ce326051, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183347845 2023-11-28 14:56:00,551 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 6a9e8bc843a2436caffa10a3279a47d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183349324 2023-11-28 14:56:00,551 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 89cd1b1088bb4e7889162c72b2838a73, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183351220 2023-11-28 14:56:00,552 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting f9cb7b90b9b342d880cc6b8929a40080, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183353136 2023-11-28 14:56:00,552 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 03403649917b4b43be14db9e71af96d6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:56:00,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7e13f46d17a8415a8bdf4c676c22ad6a, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/9cc0ea6122d64501bd1ff346b907a796, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/730f590677f64e4d802be7dab59ae0f1, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/8d5c5cafcc1d40d581d7469d3e2b8391, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/1655ad35c86f4c939ba66dbb53f1f871] to archive 2023-11-28 14:56:00,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:00,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7e13f46d17a8415a8bdf4c676c22ad6a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7e13f46d17a8415a8bdf4c676c22ad6a 2023-11-28 14:56:00,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/9cc0ea6122d64501bd1ff346b907a796 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/9cc0ea6122d64501bd1ff346b907a796 2023-11-28 14:56:00,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/730f590677f64e4d802be7dab59ae0f1 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/730f590677f64e4d802be7dab59ae0f1 2023-11-28 14:56:00,559 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): bacbb02533a4cb91b665cdf46a4cb8bc#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:56:00,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/8d5c5cafcc1d40d581d7469d3e2b8391 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/8d5c5cafcc1d40d581d7469d3e2b8391 2023-11-28 14:56:00,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/1655ad35c86f4c939ba66dbb53f1f871 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/1655ad35c86f4c939ba66dbb53f1f871 2023-11-28 14:56:00,967 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231128eaad1182ad9942848b5f9842cc14bf4e_del 2023-11-28 14:56:00,968 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128eaad1182ad9942848b5f9842cc14bf4e_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231128eaad1182ad9942848b5f9842cc14bf4e_del 2023-11-28 14:56:01,382 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8e895ee7b1948c79580d2c728c0fe70 2023-11-28 14:56:01,384 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/.tmp/family2/f8e895ee7b1948c79580d2c728c0fe70 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/f8e895ee7b1948c79580d2c728c0fe70 2023-11-28 14:56:01,387 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8e895ee7b1948c79580d2c728c0fe70 2023-11-28 14:56:01,388 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bacbb02533a4cb91b665cdf46a4cb8bc/family2 of bacbb02533a4cb91b665cdf46a4cb8bc into f8e895ee7b1948c79580d2c728c0fe70(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:56:01,388 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:56:01,388 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:56:01,389 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 66332b88690d2bc7165356ec660f3d94/family1 is initiating major compaction (all files) 2023-11-28 14:56:01,389 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:56:01,389 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:56:01,389 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 66332b88690d2bc7165356ec660f3d94/family1 in testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:56:01,389 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/bbe418e82b0c42c5a530426e1417e5c7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/c4a2a2e7c08540c29bc662b5b9a96e79, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/df1c43efc83d4673a2f1f7b3e55ed0f3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/844326ad9d024b27986ad0e951229977, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/1a5bd8c6527642668458872c28e560af] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp, totalSize=27.1 K 2023-11-28 14:56:01,389 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting bbe418e82b0c42c5a530426e1417e5c7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183347845 2023-11-28 14:56:01,390 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting c4a2a2e7c08540c29bc662b5b9a96e79, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183349323 2023-11-28 14:56:01,390 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting df1c43efc83d4673a2f1f7b3e55ed0f3, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183351220 2023-11-28 14:56:01,391 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 844326ad9d024b27986ad0e951229977, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183353135 2023-11-28 14:56:01,391 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 1a5bd8c6527642668458872c28e560af, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:56:01,401 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 66332b88690d2bc7165356ec660f3d94#family1#compaction#200 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:56:01,438 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231128f251737bf63441dda051b4f9d8d60611_del 2023-11-28 14:56:01,438 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128f251737bf63441dda051b4f9d8d60611_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231128f251737bf63441dda051b4f9d8d60611_del 2023-11-28 14:56:01,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/750f8600348b470eb1cc78e3ce326051, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/6a9e8bc843a2436caffa10a3279a47d4, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/89cd1b1088bb4e7889162c72b2838a73, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/f9cb7b90b9b342d880cc6b8929a40080, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/03403649917b4b43be14db9e71af96d6] to archive 2023-11-28 14:56:01,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:01,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/750f8600348b470eb1cc78e3ce326051 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/750f8600348b470eb1cc78e3ce326051 2023-11-28 14:56:01,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/6a9e8bc843a2436caffa10a3279a47d4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/6a9e8bc843a2436caffa10a3279a47d4 2023-11-28 14:56:01,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/89cd1b1088bb4e7889162c72b2838a73 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/89cd1b1088bb4e7889162c72b2838a73 2023-11-28 14:56:01,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/f9cb7b90b9b342d880cc6b8929a40080 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/f9cb7b90b9b342d880cc6b8929a40080 2023-11-28 14:56:01,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/03403649917b4b43be14db9e71af96d6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family2/03403649917b4b43be14db9e71af96d6 2023-11-28 14:56:01,491 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb6f1f54e0104842b18ee6e050287b97 2023-11-28 14:56:01,492 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family1/cb6f1f54e0104842b18ee6e050287b97 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/cb6f1f54e0104842b18ee6e050287b97 2023-11-28 14:56:01,515 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb6f1f54e0104842b18ee6e050287b97 2023-11-28 14:56:01,516 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 66332b88690d2bc7165356ec660f3d94/family1 of 66332b88690d2bc7165356ec660f3d94 into cb6f1f54e0104842b18ee6e050287b97(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:56:01,516 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:56:01,516 DEBUG [Listener at localhost/45519] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-28 14:56:01,516 DEBUG [Listener at localhost/45519] regionserver.HStore(1912): 66332b88690d2bc7165356ec660f3d94/family2 is initiating major compaction (all files) 2023-11-28 14:56:01,516 INFO [Listener at localhost/45519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-28 14:56:01,516 INFO [Listener at localhost/45519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-28 14:56:01,517 INFO [Listener at localhost/45519] regionserver.HRegion(2259): Starting compaction of 66332b88690d2bc7165356ec660f3d94/family2 in testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:56:01,517 INFO [Listener at localhost/45519] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/1520c63239b44e8f9520d9eaca4c2ca0, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/bc0c42d914a24ed09df637eac0fbe3f5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/f90ddb61ef7c4f14b3cdaf0f179f5a2a, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/091ceb9cc0a74a4a92bb2418f0ff272f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/12c7dd9868174dcab4434f0d4d8f087b] into tmpdir=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp, totalSize=25.4 K 2023-11-28 14:56:01,517 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 1520c63239b44e8f9520d9eaca4c2ca0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701183347845 2023-11-28 14:56:01,517 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting bc0c42d914a24ed09df637eac0fbe3f5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701183349323 2023-11-28 14:56:01,518 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting f90ddb61ef7c4f14b3cdaf0f179f5a2a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701183351220 2023-11-28 14:56:01,518 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 091ceb9cc0a74a4a92bb2418f0ff272f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701183353135 2023-11-28 14:56:01,518 DEBUG [Listener at localhost/45519] compactions.Compactor(207): Compacting 12c7dd9868174dcab4434f0d4d8f087b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-28 14:56:01,526 INFO [Listener at localhost/45519] throttle.PressureAwareThroughputController(145): 66332b88690d2bc7165356ec660f3d94#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-28 14:56:01,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/bbe418e82b0c42c5a530426e1417e5c7, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/c4a2a2e7c08540c29bc662b5b9a96e79, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/df1c43efc83d4673a2f1f7b3e55ed0f3, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/844326ad9d024b27986ad0e951229977, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/1a5bd8c6527642668458872c28e560af] to archive 2023-11-28 14:56:01,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:01,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/bbe418e82b0c42c5a530426e1417e5c7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/bbe418e82b0c42c5a530426e1417e5c7 2023-11-28 14:56:01,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/c4a2a2e7c08540c29bc662b5b9a96e79 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/c4a2a2e7c08540c29bc662b5b9a96e79 2023-11-28 14:56:01,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/df1c43efc83d4673a2f1f7b3e55ed0f3 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/df1c43efc83d4673a2f1f7b3e55ed0f3 2023-11-28 14:56:01,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/844326ad9d024b27986ad0e951229977 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/844326ad9d024b27986ad0e951229977 2023-11-28 14:56:01,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/1a5bd8c6527642668458872c28e560af to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/1a5bd8c6527642668458872c28e560af 2023-11-28 14:56:01,933 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023112822c19cb217344e73ab0d463aeec40165_del 2023-11-28 14:56:01,933 INFO [Listener at localhost/45519] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112822c19cb217344e73ab0d463aeec40165_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112822c19cb217344e73ab0d463aeec40165_del 2023-11-28 14:56:02,370 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8113e99ab962414ebafda26f7ddd0f52 2023-11-28 14:56:02,371 DEBUG [Listener at localhost/45519] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/.tmp/family2/8113e99ab962414ebafda26f7ddd0f52 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/8113e99ab962414ebafda26f7ddd0f52 2023-11-28 14:56:02,375 INFO [Listener at localhost/45519] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8113e99ab962414ebafda26f7ddd0f52 2023-11-28 14:56:02,378 INFO [Listener at localhost/45519] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 66332b88690d2bc7165356ec660f3d94/family2 of 66332b88690d2bc7165356ec660f3d94 into 8113e99ab962414ebafda26f7ddd0f52(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-28 14:56:02,378 DEBUG [Listener at localhost/45519] regionserver.HRegion(2289): Compaction status journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:56:02,382 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:56:02,385 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:56:02,393 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:56:02,394 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:56:02,402 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35905] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x107\x94\xD9\x068\x8F\x5C\xE1\x91\xD0\xCE\xAC\x86?\x8DR"\x10\x89\x02'\x1C \x87%\x94\xD5\x02SL\xC6x\x0B\xDD*\x10\xAC\xA9\x99e\xAC\x03\xC1\xCF\xB7hi\xCB\xEF1\x0Ao2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-28 14:56:02,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-28 14:56:02,447 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-28 14:56:02,448 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701183962448 2023-11-28 14:56:02,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:56:02,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-28 14:56:02,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/1520c63239b44e8f9520d9eaca4c2ca0, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/bc0c42d914a24ed09df637eac0fbe3f5, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/f90ddb61ef7c4f14b3cdaf0f179f5a2a, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/091ceb9cc0a74a4a92bb2418f0ff272f, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/12c7dd9868174dcab4434f0d4d8f087b] to archive 2023-11-28 14:56:02,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:02,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/1520c63239b44e8f9520d9eaca4c2ca0 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/1520c63239b44e8f9520d9eaca4c2ca0 2023-11-28 14:56:02,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/bc0c42d914a24ed09df637eac0fbe3f5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/bc0c42d914a24ed09df637eac0fbe3f5 2023-11-28 14:56:02,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/f90ddb61ef7c4f14b3cdaf0f179f5a2a to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/f90ddb61ef7c4f14b3cdaf0f179f5a2a 2023-11-28 14:56:02,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/091ceb9cc0a74a4a92bb2418f0ff272f to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/091ceb9cc0a74a4a92bb2418f0ff272f 2023-11-28 14:56:02,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/12c7dd9868174dcab4434f0d4d8f087b to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family2/12c7dd9868174dcab4434f0d4d8f087b 2023-11-28 14:56:02,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-28 14:56:02,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231128101ece87edee418d8d7c72e5b7c9d3dd_del 2023-11-28 14:56:02,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231128f251737bf63441dda051b4f9d8d60611_del 2023-11-28 14:56:02,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231128b9c8b5b0266b4179b2fd16066027145b_del 2023-11-28 14:56:02,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-28 14:56:02,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] zookeeper.ReadOnlyZKClient(139): Connect 0x4c2ba562 to 127.0.0.1:62725 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-28 14:56:02,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d35d231, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-28 14:56:02,871 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231128 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-28 14:56:03,425 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231128a6e135e5497e4840bc09f8c6c8afcdef to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128a6e135e5497e4840bc09f8c6c8afcdef 2023-11-28 14:56:03,426 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='testMajorCompactionFromAdmin' column='family1' 2023-11-28 14:56:03,442 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-28 14:56:03,445 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-28 14:56:03,455 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-28 14:56:03,457 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-28 14:56:03,498 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231128/family1/bc26f515f6cf430bac1da727adbe9309 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-28 14:56:03,499 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231128/family1/bc26f515f6cf430bac1da727adbe9309}] 2023-11-28 14:56:03,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231128/family1/bc26f515f6cf430bac1da727adbe9309 for inclusion in e7248b483b8790142454233d994c4e7a/family1 2023-11-28 14:56:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-28 14:56:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first= last=1 2023-11-28 14:56:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:56:03,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231128/family1/bc26f515f6cf430bac1da727adbe9309 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__sve3fl9fegojgh84baff286278s97etjcr8bsfj8j7tem57roi82t434stu3tc95/family1/bc26f515f6cf430bac1da727adbe9309 2023-11-28 14:56:03,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__sve3fl9fegojgh84baff286278s97etjcr8bsfj8j7tem57roi82t434stu3tc95/family1/bc26f515f6cf430bac1da727adbe9309 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/16856668081344fcb1528fe7cbec6c68_SeqId_28_ 2023-11-28 14:56:03,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__sve3fl9fegojgh84baff286278s97etjcr8bsfj8j7tem57roi82t434stu3tc95/family1/bc26f515f6cf430bac1da727adbe9309 into e7248b483b8790142454233d994c4e7a/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/16856668081344fcb1528fe7cbec6c68_SeqId_28_ - updating store file list. 2023-11-28 14:56:03,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/16856668081344fcb1528fe7cbec6c68_SeqId_28_ into e7248b483b8790142454233d994c4e7a/family1 2023-11-28 14:56:03,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__sve3fl9fegojgh84baff286278s97etjcr8bsfj8j7tem57roi82t434stu3tc95/family1/bc26f515f6cf430bac1da727adbe9309 into e7248b483b8790142454233d994c4e7a/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/family1/16856668081344fcb1528fe7cbec6c68_SeqId_28_) 2023-11-28 14:56:03,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__sve3fl9fegojgh84baff286278s97etjcr8bsfj8j7tem57roi82t434stu3tc95/family1/bc26f515f6cf430bac1da727adbe9309 2023-11-28 14:56:03,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231128 table='testMajorCompactionFromAdmin' column='family1' 2023-11-28 14:56:03,556 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:03,557 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128357f73fdab6a473b9cf59e4d16f764ca to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128357f73fdab6a473b9cf59e4d16f764ca 2023-11-28 14:56:03,558 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112844bef5d63ee54d859351d287ddafacb4 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112844bef5d63ee54d859351d287ddafacb4 2023-11-28 14:56:03,558 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311288cd72de9bda649028260f9e85673baa5 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311288cd72de9bda649028260f9e85673baa5 2023-11-28 14:56:03,559 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128bb0274a62cbb41ddb0676b552b5eadf0 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128bb0274a62cbb41ddb0676b552b5eadf0 2023-11-28 14:56:03,559 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-28 14:56:03,559 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231128' 2023-11-28 14:56:03,559 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231128 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-28 14:56:03,560 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231128 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-28 14:56:04,112 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231128f9647b6918834e3dba70275033d25550 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128f9647b6918834e3dba70275033d25550 2023-11-28 14:56:04,113 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='testMajorCompactionFromAdmin' column='family1' 2023-11-28 14:56:04,163 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231128/family1/b0dc073a5e2d4c56a561c372c6bbb034 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-28 14:56:04,164 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231128/family1/b0dc073a5e2d4c56a561c372c6bbb034}] 2023-11-28 14:56:04,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231128/family1/b0dc073a5e2d4c56a561c372c6bbb034 for inclusion in bacbb02533a4cb91b665cdf46a4cb8bc/family1 2023-11-28 14:56:04,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-28 14:56:04,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-28 14:56:04,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:56:04,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231128/family1/b0dc073a5e2d4c56a561c372c6bbb034 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__965vti3ljb5j3el24ebilrldos438pvkknr7kau5vereggl8qsdn8lhp5budcqa7/family1/b0dc073a5e2d4c56a561c372c6bbb034 2023-11-28 14:56:04,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__965vti3ljb5j3el24ebilrldos438pvkknr7kau5vereggl8qsdn8lhp5budcqa7/family1/b0dc073a5e2d4c56a561c372c6bbb034 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7b6ab3f7f4fa4860aed0e3fe28e83b81_SeqId_28_ 2023-11-28 14:56:04,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__965vti3ljb5j3el24ebilrldos438pvkknr7kau5vereggl8qsdn8lhp5budcqa7/family1/b0dc073a5e2d4c56a561c372c6bbb034 into bacbb02533a4cb91b665cdf46a4cb8bc/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7b6ab3f7f4fa4860aed0e3fe28e83b81_SeqId_28_ - updating store file list. 2023-11-28 14:56:04,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7b6ab3f7f4fa4860aed0e3fe28e83b81_SeqId_28_ into bacbb02533a4cb91b665cdf46a4cb8bc/family1 2023-11-28 14:56:04,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__965vti3ljb5j3el24ebilrldos438pvkknr7kau5vereggl8qsdn8lhp5budcqa7/family1/b0dc073a5e2d4c56a561c372c6bbb034 into bacbb02533a4cb91b665cdf46a4cb8bc/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/family1/7b6ab3f7f4fa4860aed0e3fe28e83b81_SeqId_28_) 2023-11-28 14:56:04,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__965vti3ljb5j3el24ebilrldos438pvkknr7kau5vereggl8qsdn8lhp5budcqa7/family1/b0dc073a5e2d4c56a561c372c6bbb034 2023-11-28 14:56:04,254 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231128 table='testMajorCompactionFromAdmin' column='family1' 2023-11-28 14:56:04,255 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:04,256 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311280e034cf3295f48b2a7532d6a45063277 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311280e034cf3295f48b2a7532d6a45063277 2023-11-28 14:56:04,258 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311281503beaa8c104f8f88f74366dc6bdb31 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311281503beaa8c104f8f88f74366dc6bdb31 2023-11-28 14:56:04,259 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128524d829178384256a093a387ec19ed29 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128524d829178384256a093a387ec19ed29 2023-11-28 14:56:04,261 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128e738f0eaced346c0b30d2951bbca9fe7 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128e738f0eaced346c0b30d2951bbca9fe7 2023-11-28 14:56:04,261 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-28 14:56:04,261 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231128' 2023-11-28 14:56:04,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231128 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-28 14:56:04,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231128 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-28 14:56:05,276 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231128b4cadd8953544ba68fc2e85199dc88b6 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231128b4cadd8953544ba68fc2e85199dc88b6 2023-11-28 14:56:05,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231128 table='testMajorCompactionFromAdmin' column='family1' 2023-11-28 14:56:05,318 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231128/family1/bac6bddaf2fb4570a983bc3a925e6c23 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-28 14:56:05,319 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94., hostname=jenkins-hbase4.apache.org,41403,1701183201531, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231128/family1/bac6bddaf2fb4570a983bc3a925e6c23}] 2023-11-28 14:56:05,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(763): Validating hfile at hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231128/family1/bac6bddaf2fb4570a983bc3a925e6c23 for inclusion in 66332b88690d2bc7165356ec660f3d94/family1 2023-11-28 14:56:05,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-28 14:56:05,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-28 14:56:05,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegion(2446): Flush status journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:56:05,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231128/family1/bac6bddaf2fb4570a983bc3a925e6c23 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__89ib0j6j3dh8tu7hgog7v5n26dnggd5oau4hdp6iqauns5qu17vg0nqp15hii9k/family1/bac6bddaf2fb4570a983bc3a925e6c23 2023-11-28 14:56:05,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__89ib0j6j3dh8tu7hgog7v5n26dnggd5oau4hdp6iqauns5qu17vg0nqp15hii9k/family1/bac6bddaf2fb4570a983bc3a925e6c23 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/d777febdebdd4e5081e8cdfce88e3616_SeqId_28_ 2023-11-28 14:56:05,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(849): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__89ib0j6j3dh8tu7hgog7v5n26dnggd5oau4hdp6iqauns5qu17vg0nqp15hii9k/family1/bac6bddaf2fb4570a983bc3a925e6c23 into 66332b88690d2bc7165356ec660f3d94/family1 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/d777febdebdd4e5081e8cdfce88e3616_SeqId_28_ - updating store file list. 2023-11-28 14:56:05,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(882): Loaded HFile hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/d777febdebdd4e5081e8cdfce88e3616_SeqId_28_ into 66332b88690d2bc7165356ec660f3d94/family1 2023-11-28 14:56:05,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.HStore(855): Successfully loaded hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__89ib0j6j3dh8tu7hgog7v5n26dnggd5oau4hdp6iqauns5qu17vg0nqp15hii9k/family1/bac6bddaf2fb4570a983bc3a925e6c23 into 66332b88690d2bc7165356ec660f3d94/family1 (new location: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/family1/d777febdebdd4e5081e8cdfce88e3616_SeqId_28_) 2023-11-28 14:56:05,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41403] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/staging/jenkins__testMajorCompactionFromAdmin__89ib0j6j3dh8tu7hgog7v5n26dnggd5oau4hdp6iqauns5qu17vg0nqp15hii9k/family1/bac6bddaf2fb4570a983bc3a925e6c23 2023-11-28 14:56:05,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231128 table='testMajorCompactionFromAdmin' column='family1' 2023-11-28 14:56:05,374 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:05,375 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311280ca4dbf347f3406aba788240bd1e7549 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311280ca4dbf347f3406aba788240bd1e7549 2023-11-28 14:56:05,376 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112867dd24ee4ef744dfba507efc4a9312ee to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023112867dd24ee4ef744dfba507efc4a9312ee 2023-11-28 14:56:05,377 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311288eecf2de8c604fb485d6b1bec3a5ea51 to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311288eecf2de8c604fb485d6b1bec3a5ea51 2023-11-28 14:56:05,378 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231128fa97f4354def4687ad3108a750e7cacc to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231128fa97f4354def4687ad3108a750e7cacc 2023-11-28 14:56:05,378 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-28 14:56:05,378 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231128' 2023-11-28 14:56:05,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231128 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-28 14:56:05,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-28 14:56:05,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-28 14:56:05,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128101ece87edee418d8d7c72e5b7c9d3dd_del] 2023-11-28 14:56:05,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:05,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128101ece87edee418d8d7c72e5b7c9d3dd_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231128101ece87edee418d8d7c72e5b7c9d3dd_del 2023-11-28 14:56:05,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-28 14:56:05,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231128f251737bf63441dda051b4f9d8d60611_del] 2023-11-28 14:56:05,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:05,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231128f251737bf63441dda051b4f9d8d60611_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231128f251737bf63441dda051b4f9d8d60611_del 2023-11-28 14:56:05,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-28 14:56:05,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] compactions.PartitionedMobCompactor(367): [hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128b9c8b5b0266b4179b2fd16066027145b_del] 2023-11-28 14:56:05,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] backup.HFileArchiver(360): Archiving compacted files. 2023-11-28 14:56:05,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128b9c8b5b0266b4179b2fd16066027145b_del to hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231128b9c8b5b0266b4179b2fd16066027145b_del 2023-11-28 14:56:05,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-28 14:56:05,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701183204732] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-28 14:56:05,384 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-28 14:56:05,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.9390 sec 2023-11-28 14:56:05,404 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:56:05,406 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:56:05,408 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-28 14:56:05,409 DEBUG [Listener at localhost/45519] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-28 14:56:05,413 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-28 14:56:05,450 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=252 (was 262), OpenFileDescriptor=665 (was 694), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 227), ProcessCount=169 (was 171), AvailableMemoryMB=7149 (was 7689) 2023-11-28 14:56:05,450 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31f4d39e to 127.0.0.1:62725 2023-11-28 14:56:05,450 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:56:05,451 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-28 14:56:05,451 INFO [Listener at localhost/45519] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-28 14:56:05,451 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ed63e4c to 127.0.0.1:62725 2023-11-28 14:56:05,451 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:56:05,451 DEBUG [Listener at localhost/45519] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-28 14:56:05,451 DEBUG [Listener at localhost/45519] util.JVMClusterUtil(257): Found active master hash=1082545184, stopped=false 2023-11-28 14:56:05,451 INFO [Listener at localhost/45519] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:56:05,453 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-28 14:56:05,453 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-28 14:56:05,453 INFO [Listener at localhost/45519] procedure2.ProcedureExecutor(628): Stopping 2023-11-28 14:56:05,453 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:56:05,453 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e9f2ec5 to 127.0.0.1:62725 2023-11-28 14:56:05,453 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:56:05,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-28 14:56:05,453 INFO [Listener at localhost/45519] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,41403,1701183201531' ***** 2023-11-28 14:56:05,454 INFO [Listener at localhost/45519] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2023-11-28 14:56:05,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-28 14:56:05,454 INFO [RS:0;jenkins-hbase4:41403] regionserver.HeapMemoryManager(220): Stopping 2023-11-28 14:56:05,454 INFO [RS:0;jenkins-hbase4:41403] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-28 14:56:05,454 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-28 14:56:05,454 INFO [RS:0;jenkins-hbase4:41403] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-28 14:56:05,454 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 1bb70c27ff1b18e08e734bf4055ade3d 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 9bb0b6cc0ca47b17cc23194994ed6155 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for ad7ce42a0018a9c883486c1d65dc4fc6 2023-11-28 14:56:05,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1bb70c27ff1b18e08e734bf4055ade3d, disabling compactions & flushes 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for c28198633832a22507986a5565e93344 2023-11-28 14:56:05,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 7ba6d0f18a6921527c5bcad98b88e9c1 2023-11-28 14:56:05,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for abb9d45cdbc2ef61c7505454675c3700 2023-11-28 14:56:05,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. after waiting 0 ms 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for f28c888789b361292b656b9a5c9a6421 2023-11-28 14:56:05,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 7b2311d47e8559d20609d4cfb34d2d49 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for e7248b483b8790142454233d994c4e7a 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 39f87ce083221dfe6b6ace19f8c17d49 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 57c598eec81de40a9c00524003304d89 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for bacbb02533a4cb91b665cdf46a4cb8bc 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 8c0faa1ee29720150b9862889d03d38b 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 070be3ce089c4943b771f3d4086624ce 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 6fb4f2fcb12d20bd93bd596633c6e1d9 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 66332b88690d2bc7165356ec660f3d94 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for f72347106c868af4e8e3936f91e9251a 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for f3c7b6ddba4fb335b7b80f9c108e93ef 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 1cefad5833bb4721eba3b87e37e62e55 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 0d8b3179009e319055dc6b8e4ffb7b2a 2023-11-28 14:56:05,455 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:56:05,456 DEBUG [RS:0;jenkins-hbase4:41403] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7daaa6e8 to 127.0.0.1:62725 2023-11-28 14:56:05,456 DEBUG [RS:0;jenkins-hbase4:41403] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:56:05,456 INFO [RS:0;jenkins-hbase4:41403] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-28 14:56:05,456 INFO [RS:0;jenkins-hbase4:41403] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-28 14:56:05,456 INFO [RS:0;jenkins-hbase4:41403] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-28 14:56:05,456 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2023-11-28 14:56:05,456 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1477): Waiting on 21 regions to close 2023-11-28 14:56:05,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-28 14:56:05,457 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-28 14:56:05,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-28 14:56:05,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-28 14:56:05,457 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-28 14:56:05,457 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-28 14:56:05,457 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1507): Waiting on 070be3ce089c4943b771f3d4086624ce, 0d8b3179009e319055dc6b8e4ffb7b2a, 1588230740, 1bb70c27ff1b18e08e734bf4055ade3d, 1cefad5833bb4721eba3b87e37e62e55, 39f87ce083221dfe6b6ace19f8c17d49, 57c598eec81de40a9c00524003304d89, 66332b88690d2bc7165356ec660f3d94, 6fb4f2fcb12d20bd93bd596633c6e1d9, 7b2311d47e8559d20609d4cfb34d2d49, 7ba6d0f18a6921527c5bcad98b88e9c1, 8c0faa1ee29720150b9862889d03d38b, 9bb0b6cc0ca47b17cc23194994ed6155, abb9d45cdbc2ef61c7505454675c3700, ad7ce42a0018a9c883486c1d65dc4fc6, bacbb02533a4cb91b665cdf46a4cb8bc, c28198633832a22507986a5565e93344, e7248b483b8790142454233d994c4e7a, f28c888789b361292b656b9a5c9a6421, f3c7b6ddba4fb335b7b80f9c108e93ef, f72347106c868af4e8e3936f91e9251a 2023-11-28 14:56:05,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1bb70c27ff1b18e08e734bf4055ade3d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-28 14:56:05,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:56:05,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1bb70c27ff1b18e08e734bf4055ade3d: 2023-11-28 14:56:05,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1701183318421.1bb70c27ff1b18e08e734bf4055ade3d. 2023-11-28 14:56:05,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9bb0b6cc0ca47b17cc23194994ed6155, disabling compactions & flushes 2023-11-28 14:56:05,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:56:05,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:56:05,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. after waiting 0 ms 2023-11-28 14:56:05,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:56:05,462 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-28 14:56:05,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithMonthlyPolicy/9bb0b6cc0ca47b17cc23194994ed6155/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-28 14:56:05,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:56:05,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9bb0b6cc0ca47b17cc23194994ed6155: 2023-11-28 14:56:05,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1701183217620.9bb0b6cc0ca47b17cc23194994ed6155. 2023-11-28 14:56:05,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ad7ce42a0018a9c883486c1d65dc4fc6, disabling compactions & flushes 2023-11-28 14:56:05,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:56:05,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:56:05,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. after waiting 0 ms 2023-11-28 14:56:05,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:56:05,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithWeeklyPolicy/ad7ce42a0018a9c883486c1d65dc4fc6/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-28 14:56:05,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:56:05,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ad7ce42a0018a9c883486c1d65dc4fc6: 2023-11-28 14:56:05,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1701183231767.ad7ce42a0018a9c883486c1d65dc4fc6. 2023-11-28 14:56:05,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c28198633832a22507986a5565e93344, disabling compactions & flushes 2023-11-28 14:56:05,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:56:05,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:56:05,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. after waiting 0 ms 2023-11-28 14:56:05,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:56:05,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/c28198633832a22507986a5565e93344/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-28 14:56:05,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:56:05,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c28198633832a22507986a5565e93344: 2023-11-28 14:56:05,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701183260094.c28198633832a22507986a5565e93344. 2023-11-28 14:56:05,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ba6d0f18a6921527c5bcad98b88e9c1, disabling compactions & flushes 2023-11-28 14:56:05,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:56:05,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:56:05,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. after waiting 0 ms 2023-11-28 14:56:05,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:56:05,479 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/.tmp/info/a26f8a57f2e74ae6804fda95ba42aff4 2023-11-28 14:56:05,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/7ba6d0f18a6921527c5bcad98b88e9c1/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-28 14:56:05,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:56:05,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ba6d0f18a6921527c5bcad98b88e9c1: 2023-11-28 14:56:05,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1701183296083.7ba6d0f18a6921527c5bcad98b88e9c1. 2023-11-28 14:56:05,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing abb9d45cdbc2ef61c7505454675c3700, disabling compactions & flushes 2023-11-28 14:56:05,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:56:05,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:56:05,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. after waiting 0 ms 2023-11-28 14:56:05,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:56:05,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a26f8a57f2e74ae6804fda95ba42aff4 2023-11-28 14:56:05,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/abb9d45cdbc2ef61c7505454675c3700/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-28 14:56:05,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:56:05,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for abb9d45cdbc2ef61c7505454675c3700: 2023-11-28 14:56:05,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1701183241723.abb9d45cdbc2ef61c7505454675c3700. 2023-11-28 14:56:05,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f28c888789b361292b656b9a5c9a6421, disabling compactions & flushes 2023-11-28 14:56:05,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:56:05,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:56:05,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. after waiting 0 ms 2023-11-28 14:56:05,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:56:05,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/f28c888789b361292b656b9a5c9a6421/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-28 14:56:05,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:56:05,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f28c888789b361292b656b9a5c9a6421: 2023-11-28 14:56:05,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701183273959.f28c888789b361292b656b9a5c9a6421. 2023-11-28 14:56:05,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7b2311d47e8559d20609d4cfb34d2d49, disabling compactions & flushes 2023-11-28 14:56:05,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:56:05,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:56:05,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. after waiting 0 ms 2023-11-28 14:56:05,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:56:05,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/7b2311d47e8559d20609d4cfb34d2d49/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-28 14:56:05,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:56:05,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7b2311d47e8559d20609d4cfb34d2d49: 2023-11-28 14:56:05,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1701183318421.7b2311d47e8559d20609d4cfb34d2d49. 2023-11-28 14:56:05,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7248b483b8790142454233d994c4e7a, disabling compactions & flushes 2023-11-28 14:56:05,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:56:05,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:56:05,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. after waiting 0 ms 2023-11-28 14:56:05,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:56:05,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/e7248b483b8790142454233d994c4e7a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-28 14:56:05,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:56:05,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7248b483b8790142454233d994c4e7a: 2023-11-28 14:56:05,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1701183345701.e7248b483b8790142454233d994c4e7a. 2023-11-28 14:56:05,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 39f87ce083221dfe6b6ace19f8c17d49, disabling compactions & flushes 2023-11-28 14:56:05,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:56:05,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:56:05,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. after waiting 0 ms 2023-11-28 14:56:05,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:56:05,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 39f87ce083221dfe6b6ace19f8c17d49 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-28 14:56:05,509 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-28 14:56:05,658 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1507): Waiting on 070be3ce089c4943b771f3d4086624ce, 0d8b3179009e319055dc6b8e4ffb7b2a, 1588230740, 1cefad5833bb4721eba3b87e37e62e55, 39f87ce083221dfe6b6ace19f8c17d49, 57c598eec81de40a9c00524003304d89, 66332b88690d2bc7165356ec660f3d94, 6fb4f2fcb12d20bd93bd596633c6e1d9, 8c0faa1ee29720150b9862889d03d38b, bacbb02533a4cb91b665cdf46a4cb8bc, f3c7b6ddba4fb335b7b80f9c108e93ef, f72347106c868af4e8e3936f91e9251a 2023-11-28 14:56:05,704 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-28 14:56:05,704 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-28 14:56:05,858 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1507): Waiting on 070be3ce089c4943b771f3d4086624ce, 0d8b3179009e319055dc6b8e4ffb7b2a, 1588230740, 1cefad5833bb4721eba3b87e37e62e55, 39f87ce083221dfe6b6ace19f8c17d49, 57c598eec81de40a9c00524003304d89, 66332b88690d2bc7165356ec660f3d94, 6fb4f2fcb12d20bd93bd596633c6e1d9, 8c0faa1ee29720150b9862889d03d38b, bacbb02533a4cb91b665cdf46a4cb8bc, f3c7b6ddba4fb335b7b80f9c108e93ef, f72347106c868af4e8e3936f91e9251a 2023-11-28 14:56:05,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/.tmp/rep_barrier/48d0a0ea674f4c719136917485f5bf06 2023-11-28 14:56:05,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48d0a0ea674f4c719136917485f5bf06 2023-11-28 14:56:05,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49/.tmp/info/b351625f90c14ef0a7b140b3d430a6b6 2023-11-28 14:56:05,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49/.tmp/info/b351625f90c14ef0a7b140b3d430a6b6 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49/info/b351625f90c14ef0a7b140b3d430a6b6 2023-11-28 14:56:05,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49/info/b351625f90c14ef0a7b140b3d430a6b6, entries=3, sequenceid=7, filesize=4.8 K 2023-11-28 14:56:05,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 39f87ce083221dfe6b6ace19f8c17d49 in 413ms, sequenceid=7, compaction requested=false 2023-11-28 14:56:05,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/namespace/39f87ce083221dfe6b6ace19f8c17d49/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-28 14:56:05,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:56:05,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 39f87ce083221dfe6b6ace19f8c17d49: 2023-11-28 14:56:05,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1701183204109.39f87ce083221dfe6b6ace19f8c17d49. 2023-11-28 14:56:05,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 57c598eec81de40a9c00524003304d89, disabling compactions & flushes 2023-11-28 14:56:05,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:56:05,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:56:05,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. after waiting 0 ms 2023-11-28 14:56:05,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:56:05,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/57c598eec81de40a9c00524003304d89/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-28 14:56:05,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:56:05,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 57c598eec81de40a9c00524003304d89: 2023-11-28 14:56:05,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1701183241723.57c598eec81de40a9c00524003304d89. 2023-11-28 14:56:05,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bacbb02533a4cb91b665cdf46a4cb8bc, disabling compactions & flushes 2023-11-28 14:56:05,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:56:05,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:56:05,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. after waiting 0 ms 2023-11-28 14:56:05,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:56:05,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/bacbb02533a4cb91b665cdf46a4cb8bc/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-28 14:56:05,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:56:05,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bacbb02533a4cb91b665cdf46a4cb8bc: 2023-11-28 14:56:05,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1701183345701.bacbb02533a4cb91b665cdf46a4cb8bc. 2023-11-28 14:56:05,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8c0faa1ee29720150b9862889d03d38b, disabling compactions & flushes 2023-11-28 14:56:05,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:56:05,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:56:05,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. after waiting 0 ms 2023-11-28 14:56:05,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:56:05,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testScannerOnBulkLoadRefHFiles/8c0faa1ee29720150b9862889d03d38b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-28 14:56:05,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:56:05,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8c0faa1ee29720150b9862889d03d38b: 2023-11-28 14:56:05,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1701183241723.8c0faa1ee29720150b9862889d03d38b. 2023-11-28 14:56:05,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 070be3ce089c4943b771f3d4086624ce, disabling compactions & flushes 2023-11-28 14:56:05,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:56:05,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:56:05,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. after waiting 0 ms 2023-11-28 14:56:05,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:56:05,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMinorCompactionWithMonthlyPolicy/070be3ce089c4943b771f3d4086624ce/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-28 14:56:05,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:56:05,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 070be3ce089c4943b771f3d4086624ce: 2023-11-28 14:56:05,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1701183336037.070be3ce089c4943b771f3d4086624ce. 2023-11-28 14:56:05,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6fb4f2fcb12d20bd93bd596633c6e1d9, disabling compactions & flushes 2023-11-28 14:56:05,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:56:05,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:56:05,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. after waiting 0 ms 2023-11-28 14:56:05,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:56:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/6fb4f2fcb12d20bd93bd596633c6e1d9/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-28 14:56:05,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:56:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6fb4f2fcb12d20bd93bd596633c6e1d9: 2023-11-28 14:56:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1701183296083.6fb4f2fcb12d20bd93bd596633c6e1d9. 2023-11-28 14:56:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 66332b88690d2bc7165356ec660f3d94, disabling compactions & flushes 2023-11-28 14:56:05,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:56:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:56:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. after waiting 0 ms 2023-11-28 14:56:05,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:56:05,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionFromAdmin/66332b88690d2bc7165356ec660f3d94/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-28 14:56:05,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:56:05,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 66332b88690d2bc7165356ec660f3d94: 2023-11-28 14:56:05,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1701183345701.66332b88690d2bc7165356ec660f3d94. 2023-11-28 14:56:05,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f72347106c868af4e8e3936f91e9251a, disabling compactions & flushes 2023-11-28 14:56:05,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:56:05,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:56:05,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. after waiting 0 ms 2023-11-28 14:56:05,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:56:05,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testCompactionWithHFileLink/f72347106c868af4e8e3936f91e9251a/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-28 14:56:05,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:56:05,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f72347106c868af4e8e3936f91e9251a: 2023-11-28 14:56:05,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1701183296083.f72347106c868af4e8e3936f91e9251a. 2023-11-28 14:56:05,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f3c7b6ddba4fb335b7b80f9c108e93ef, disabling compactions & flushes 2023-11-28 14:56:05,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:56:05,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:56:05,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. after waiting 0 ms 2023-11-28 14:56:05,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:56:05,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyPolicy/f3c7b6ddba4fb335b7b80f9c108e93ef/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-28 14:56:05,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:56:05,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f3c7b6ddba4fb335b7b80f9c108e93ef: 2023-11-28 14:56:05,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1701183246730.f3c7b6ddba4fb335b7b80f9c108e93ef. 2023-11-28 14:56:05,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1cefad5833bb4721eba3b87e37e62e55, disabling compactions & flushes 2023-11-28 14:56:05,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:56:05,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:56:05,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. after waiting 0 ms 2023-11-28 14:56:05,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:56:05,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/ns/testMinorCompaction/1cefad5833bb4721eba3b87e37e62e55/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-28 14:56:05,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:56:05,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1cefad5833bb4721eba3b87e37e62e55: 2023-11-28 14:56:05,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1701183318421.1cefad5833bb4721eba3b87e37e62e55. 2023-11-28 14:56:05,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d8b3179009e319055dc6b8e4ffb7b2a, disabling compactions & flushes 2023-11-28 14:56:05,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:56:05,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:56:05,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. after waiting 0 ms 2023-11-28 14:56:05,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:56:05,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0d8b3179009e319055dc6b8e4ffb7b2a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-28 14:56:05,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:56:05,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d8b3179009e319055dc6b8e4ffb7b2a: 2023-11-28 14:56:05,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701183204903.0d8b3179009e319055dc6b8e4ffb7b2a. 2023-11-28 14:56:06,058 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-11-28 14:56:06,258 DEBUG [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1507): Waiting on 1588230740 2023-11-28 14:56:06,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/.tmp/table/1cf66ab750e248838cc0f6fdac79193c 2023-11-28 14:56:06,303 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1cf66ab750e248838cc0f6fdac79193c 2023-11-28 14:56:06,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/.tmp/info/a26f8a57f2e74ae6804fda95ba42aff4 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/info/a26f8a57f2e74ae6804fda95ba42aff4 2023-11-28 14:56:06,307 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a26f8a57f2e74ae6804fda95ba42aff4 2023-11-28 14:56:06,307 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/info/a26f8a57f2e74ae6804fda95ba42aff4, entries=226, sequenceid=130, filesize=37.9 K 2023-11-28 14:56:06,307 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/.tmp/rep_barrier/48d0a0ea674f4c719136917485f5bf06 as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/rep_barrier/48d0a0ea674f4c719136917485f5bf06 2023-11-28 14:56:06,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48d0a0ea674f4c719136917485f5bf06 2023-11-28 14:56:06,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/rep_barrier/48d0a0ea674f4c719136917485f5bf06, entries=1, sequenceid=130, filesize=5.0 K 2023-11-28 14:56:06,312 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/.tmp/table/1cf66ab750e248838cc0f6fdac79193c as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/table/1cf66ab750e248838cc0f6fdac79193c 2023-11-28 14:56:06,315 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1cf66ab750e248838cc0f6fdac79193c 2023-11-28 14:56:06,315 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/table/1cf66ab750e248838cc0f6fdac79193c, entries=27, sequenceid=130, filesize=6.6 K 2023-11-28 14:56:06,317 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 860ms, sequenceid=130, compaction requested=false 2023-11-28 14:56:06,320 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-28 14:56:06,320 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-28 14:56:06,320 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-28 14:56:06,320 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-28 14:56:06,320 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-28 14:56:06,459 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,41403,1701183201531; all regions closed. 2023-11-28 14:56:06,466 DEBUG [RS:0;jenkins-hbase4:41403] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/oldWALs 2023-11-28 14:56:06,466 INFO [RS:0;jenkins-hbase4:41403] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41403%2C1701183201531.meta:.meta(num 1701183203861) 2023-11-28 14:56:06,469 DEBUG [RS:0;jenkins-hbase4:41403] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/oldWALs 2023-11-28 14:56:06,469 INFO [RS:0;jenkins-hbase4:41403] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41403%2C1701183201531:(num 1701183202854) 2023-11-28 14:56:06,469 DEBUG [RS:0;jenkins-hbase4:41403] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:56:06,469 INFO [RS:0;jenkins-hbase4:41403] regionserver.LeaseManager(133): Closed leases 2023-11-28 14:56:06,470 INFO [RS:0;jenkins-hbase4:41403] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-28 14:56:06,470 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-28 14:56:06,471 INFO [RS:0;jenkins-hbase4:41403] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41403 2023-11-28 14:56:06,480 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41403,1701183201531 2023-11-28 14:56:06,480 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-28 14:56:06,480 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-28 14:56:06,481 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41403,1701183201531] 2023-11-28 14:56:06,482 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41403,1701183201531; numProcessing=1 2023-11-28 14:56:06,483 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41403,1701183201531 already deleted, retry=false 2023-11-28 14:56:06,483 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,41403,1701183201531 expired; onlineServers=0 2023-11-28 14:56:06,483 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,35905,1701183200327' ***** 2023-11-28 14:56:06,483 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-28 14:56:06,483 DEBUG [M:0;jenkins-hbase4:35905] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bb5e1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-28 14:56:06,483 INFO [M:0;jenkins-hbase4:35905] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,35905,1701183200327 2023-11-28 14:56:06,483 INFO [M:0;jenkins-hbase4:35905] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,35905,1701183200327; all regions closed. 2023-11-28 14:56:06,483 DEBUG [M:0;jenkins-hbase4:35905] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-28 14:56:06,483 DEBUG [M:0;jenkins-hbase4:35905] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-28 14:56:06,484 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-28 14:56:06,484 DEBUG [M:0;jenkins-hbase4:35905] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-28 14:56:06,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701183202599] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701183202599,5,FailOnTimeoutGroup] 2023-11-28 14:56:06,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701183202599] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701183202599,5,FailOnTimeoutGroup] 2023-11-28 14:56:06,484 INFO [M:0;jenkins-hbase4:35905] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-28 14:56:06,484 INFO [M:0;jenkins-hbase4:35905] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-28 14:56:06,484 INFO [M:0;jenkins-hbase4:35905] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-28 14:56:06,484 DEBUG [M:0;jenkins-hbase4:35905] master.HMaster(1512): Stopping service threads 2023-11-28 14:56:06,485 INFO [M:0;jenkins-hbase4:35905] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-28 14:56:06,485 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-28 14:56:06,485 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-28 14:56:06,485 ERROR [M:0;jenkins-hbase4:35905] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-28 14:56:06,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-28 14:56:06,485 INFO [M:0;jenkins-hbase4:35905] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-28 14:56:06,486 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-28 14:56:06,486 DEBUG [M:0;jenkins-hbase4:35905] zookeeper.ZKUtil(399): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-28 14:56:06,486 WARN [M:0;jenkins-hbase4:35905] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-28 14:56:06,486 INFO [M:0;jenkins-hbase4:35905] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-28 14:56:06,486 INFO [M:0;jenkins-hbase4:35905] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-28 14:56:06,486 DEBUG [M:0;jenkins-hbase4:35905] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-28 14:56:06,486 INFO [M:0;jenkins-hbase4:35905] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-28 14:56:06,486 DEBUG [M:0;jenkins-hbase4:35905] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-28 14:56:06,486 DEBUG [M:0;jenkins-hbase4:35905] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-28 14:56:06,486 DEBUG [M:0;jenkins-hbase4:35905] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-28 14:56:06,486 INFO [M:0;jenkins-hbase4:35905] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.71 KB heapSize=598.83 KB 2023-11-28 14:56:06,581 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-28 14:56:06,581 INFO [RS:0;jenkins-hbase4:41403] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,41403,1701183201531; zookeeper connection closed. 2023-11-28 14:56:06,582 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:41403-0x100347b7ced0001, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-28 14:56:06,582 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f36e1df] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f36e1df 2023-11-28 14:56:06,582 INFO [Listener at localhost/45519] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-28 14:56:06,894 INFO [M:0;jenkins-hbase4:35905] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.71 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/297669ec059a468fa0c6f4672c31a7be 2023-11-28 14:56:06,896 INFO [M:0;jenkins-hbase4:35905] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 297669ec059a468fa0c6f4672c31a7be 2023-11-28 14:56:06,897 DEBUG [M:0;jenkins-hbase4:35905] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/297669ec059a468fa0c6f4672c31a7be as hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/297669ec059a468fa0c6f4672c31a7be 2023-11-28 14:56:06,900 INFO [M:0;jenkins-hbase4:35905] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 297669ec059a468fa0c6f4672c31a7be 2023-11-28 14:56:06,900 INFO [M:0;jenkins-hbase4:35905] regionserver.HStore(1080): Added hdfs://localhost:46715/user/jenkins/test-data/47186c15-5a85-6eaf-0349-b3b806140caf/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/297669ec059a468fa0c6f4672c31a7be, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-28 14:56:06,900 INFO [M:0;jenkins-hbase4:35905] regionserver.HRegion(2948): Finished flush of dataSize ~512.71 KB/525016, heapSize ~598.81 KB/613184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 414ms, sequenceid=1011, compaction requested=false 2023-11-28 14:56:06,901 INFO [M:0;jenkins-hbase4:35905] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-28 14:56:06,901 DEBUG [M:0;jenkins-hbase4:35905] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-28 14:56:06,904 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-28 14:56:06,904 INFO [M:0;jenkins-hbase4:35905] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-28 14:56:06,904 INFO [M:0;jenkins-hbase4:35905] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35905 2023-11-28 14:56:06,907 DEBUG [M:0;jenkins-hbase4:35905] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35905,1701183200327 already deleted, retry=false 2023-11-28 14:56:07,009 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-28 14:56:07,009 INFO [M:0;jenkins-hbase4:35905] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,35905,1701183200327; zookeeper connection closed. 2023-11-28 14:56:07,009 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:35905-0x100347b7ced0000, quorum=127.0.0.1:62725, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-28 14:56:07,011 WARN [Listener at localhost/45519] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-28 14:56:07,013 INFO [Listener at localhost/45519] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-28 14:56:07,120 WARN [BP-1874120154-172.31.14.131-1701183196873 heartbeating to localhost/127.0.0.1:46715] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-28 14:56:07,120 WARN [BP-1874120154-172.31.14.131-1701183196873 heartbeating to localhost/127.0.0.1:46715] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1874120154-172.31.14.131-1701183196873 (Datanode Uuid e9f24fa8-9bf6-4aac-9d23-0b21e1920771) service to localhost/127.0.0.1:46715 2023-11-28 14:56:07,122 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/cluster_bd31adab-41c5-d4fc-580e-11c102568516/dfs/data/data1/current/BP-1874120154-172.31.14.131-1701183196873] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-28 14:56:07,123 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/a72ee810-eba3-319a-8936-12c074899f64/cluster_bd31adab-41c5-d4fc-580e-11c102568516/dfs/data/data2/current/BP-1874120154-172.31.14.131-1701183196873] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-28 14:56:07,149 INFO [Listener at localhost/45519] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-28 14:56:07,280 INFO [Listener at localhost/45519] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-28 14:56:07,361 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(1293): Minicluster is down